-- Logs begin at Fri 2022-04-01 09:22:28 UTC, end at Fri 2022-04-01 10:35:14 UTC. -- Apr 01 09:49:24.167667 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 01 09:49:24.175296 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 1 09:49:24 2022] *** Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: nodename: dv-cinder-master-3-iscsi Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: machine: x86_64 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: clock source: unix Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: pcre jit disabled Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: detected number of CPU cores: 4 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: current working directory: / Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: detected binary path: /usr/bin/uwsgi-core Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: your processes number limit is 47680 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: your memory page size is 4096 bytes Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: detected max file descriptor number: 2048 Apr 01 09:49:24.177319 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: lock engine: pthread robust mutexes Apr 01 09:49:24.178200 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: thunder lock: enabled Apr 01 09:49:24.178200 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 01 09:49:24.178200 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 01 09:49:24.229518 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: Python main interpreter initialized at 0x556997b5b9c0 Apr 01 09:49:24.229518 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: python threads support enabled Apr 01 09:49:24.229518 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: your server socket listen backlog is limited to 100 connections Apr 01 09:49:24.229518 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: your mercy for graceful operations on workers is 90 seconds Apr 01 09:49:24.229931 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: mapped 403077 bytes (393 KB) for 2 cores Apr 01 09:49:24.230007 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: *** Operational MODE: preforking *** Apr 01 09:49:24.230299 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: *** uWSGI is running in multiple interpreter mode *** Apr 01 09:49:24.230299 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: spawned uWSGI master process (pid: 79758) Apr 01 09:49:24.230481 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 01 09:49:24.233238 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: spawned uWSGI worker 1 (pid: 79775, cores: 1) Apr 01 09:49:24.233238 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: spawned uWSGI worker 2 (pid: 79776, cores: 1) Apr 01 09:49:24.234473 dv-cinder-master-3-iscsi devstack@keystone.service[79758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 01 09:49:29.923784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:49:29.923784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: from cryptography.utils import int_from_bytes Apr 01 09:49:29.924608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:49:29.924608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: from cryptography.utils import int_from_bytes Apr 01 09:49:29.924608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:49:29.924608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: from cryptography.utils import int_from_bytes Apr 01 09:49:29.925131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:49:29.925131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: from cryptography.utils import int_from_bytes Apr 01 09:49:29.969455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 09:49:29.969664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 09:49:29.969874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 09:49:29.969976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] command line args: [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 09:49:29.970048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 09:49:29.970114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 09:49:29.970177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] command line args: [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 09:49:29.970235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ================================================================================ {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 09:49:29.970409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 09:49:29.970487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] admin_token = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.970554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ================================================================================ {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 09:49:29.970735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] config_dir = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.970830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] admin_token = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.970889 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] config_source = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] config_dir = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] debug = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] config_source = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.971498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.973793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] debug = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.973793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.973954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.973954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.974913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.975165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_config_append = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.975353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.975550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.975734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_config_append = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.975948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_dir = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_file = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_dir = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_file = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.976939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.977294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.977294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.977653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.977838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.978864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.979934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.980898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] publish_errors = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.46/identity {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.981941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] publish_errors = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.982798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] standard_threads = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.983879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] standard_threads = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] use_journal = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.984975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] use_json = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] use_journal = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] use_stderr = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] use_json = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] use_syslog = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] use_stderr = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.985903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] use_syslog = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.986043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:49:29.986297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.986977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.987954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.988953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.989972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990753 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.990892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.991898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.992905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.993796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.994849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.995912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.996936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.997938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.998062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.998190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.998320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.999571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.999742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:29.999973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.000133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.000324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.000509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.000690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.000871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.001115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.001274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.001520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.001714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.001871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.002067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.002259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.002443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.002624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.002839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.003948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.004950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.005822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.006921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.007919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.008952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.009945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.010929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011177 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.011929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.012939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.013998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.014901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.015811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.external = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.external = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.016920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.password = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] auth.token = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.password = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.017960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] auth.token = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.018874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.019895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.020916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.021929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.022890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.023939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.024923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.025877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.026990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.027999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.028954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.029879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.030918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.031043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.031168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.031301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.031429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.031897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.032915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033699 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.033956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.034990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.035898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.036921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.037971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.038914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.039937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.040960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.041968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.042879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.043903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.044920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.045933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.046952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.047969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.048967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.049865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.050886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.051905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] role.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] role.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.052911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] role.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.053936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] role.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.054888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.055907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.056925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.057921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.058896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.059913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.060939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.061945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.062960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.063992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.064991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.065880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.connection = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.066995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.067361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.067519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.067649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.connection = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.067784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.067918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.068945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.069955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.070980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:49:30.071414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 09:49:30.083669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.083871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.084008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.084150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.084314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.084461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.092930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.093121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.121702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.121973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.122198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.122394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.176560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.177109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.226201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.226527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.227219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.227416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.293431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.293753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.293753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.294922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.295052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.295204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.320214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.320523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.320664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.320883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.321895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.322143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.322143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.332915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.333376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.345812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.346941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79775) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.347719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79776) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 01 09:49:30.364437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.364670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 01 09:49:30.364812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.364962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 01 09:49:30.365093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.365220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 01 09:49:30.365360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.365486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.365613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 01 09:49:30.365749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.365880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.366006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.366133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.366258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.366392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.366392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.376752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.377912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.385631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.388855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.389131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.389412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.389697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.389966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.390173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.390313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.390448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.390747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.391015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.391280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.391487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.393428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.393704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.393986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.394254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.394529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.394852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.395071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.395322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.395583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.395849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.396108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.417761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.419371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.419620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.422220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.423812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.424093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.424780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.425168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.425446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.429305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.429592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.429911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.432600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.432883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.437009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.437206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.437348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.437480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.437793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.438071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.438357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.438633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.438940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.439191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.441634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.441921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.442190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.442469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.442746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.443018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.443262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.443548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.457525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.457778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.461755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.462001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.462218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.469755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.469755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.470098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.470098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.470386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.471078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.474581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.475284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.478200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.478494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.478806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.479006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.479170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.479311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.479580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.482345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.482639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.482945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.483222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.483444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.483739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.498350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.498602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.498917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.499148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.502639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.502929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.503212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.503424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.506903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.508639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.508919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.511249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.511996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.512448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.512745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.512889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.513032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.513355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.513555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.516508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.516784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.517070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.517354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.517638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.526462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.526916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.527098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.527257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.529019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.529329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.529616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.530764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.531050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.531304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.531953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.533688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.533980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.534272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.548116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.551422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.552418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.554810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.555851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.559334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.663418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.665202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.665483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.665767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.669457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.671127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.671411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.671665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.673044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.674611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.677988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.678278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.678558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.678771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.678858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.680419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.683746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.684033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.684312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.684582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.687959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.688241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.688516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.693423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.693704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.693972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.696463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79775) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.696736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.697115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.697388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.697660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.697935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.698214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.698484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.698769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.699034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.699312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.699574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.699836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.700107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79775) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.701785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79776) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 01 09:49:30.702057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.702430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.702704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.702991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.703264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.703539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.703801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.704069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.704331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.704607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.704847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.705104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.705366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79776) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 01 09:49:30.737511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556997b5b9c0 pid: 79775 (default app) Apr 01 09:49:30.741061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521bf-b64b-4651-8de6-0c0b30d4013e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:30.741355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521bf-b64b-4651-8de6-0c0b30d4013e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:30.741635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5521bf-b64b-4651-8de6-0c0b30d4013e None None] PATH_INFO: `/v3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:30.742436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556997b5b9c0 pid: 79776 (default app) Apr 01 09:49:30.745861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 791 bytes} [Fri Apr 1 09:49:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:39.129059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:39.129894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:39.129894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:39.138280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:39 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:39.147234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:39.148000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:39.148326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:39.180993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:49:39.378394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG passlib.handlers.bcrypt [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79775) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 01 09:49:39.378862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG passlib.handlers.bcrypt [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79775) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 01 09:49:39.436542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:39.438129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:39.568324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 01 09:49:39.730542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:39.777019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG oslo_db.sqlalchemy.engines [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:49:39.915250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d70d9-934f-4111-ac29-49667a4a743f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:39.920742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:39.921422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:39.921704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:39.921960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:39.931036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:39.980703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.common.rbac_enforcer.enforcer [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 01 09:49:39.980992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c230e6-5e53-4dcd-a174-8a119a38d361 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:39.990926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Apr 1 09:49:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 09:49:39.998152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:40.022151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d4b91-3f78-45a1-8428-3fa68dd93b10 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:40.028891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:40.030033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:40.030326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:40.030614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] PATH_INFO: `/v3/projects/049efb42322340008044df453447aaa7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:40.032669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] RBAC: Authorizing `identity:get_project(project_id=049efb42322340008044df453447aaa7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:40.083419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 01 09:49:40.083787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f297e-fc61-490f-aa79-6d8a17aea290 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:40.088468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 3/5] 10.222.0.46 () {56 vars in 1207 bytes} [Fri Apr 1 09:49:39 2022] GET /identity/v3/projects/049efb42322340008044df453447aaa7 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:42.308322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafb4be-34ee-4819-ba20-f4953479e5c7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:42.308889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafb4be-34ee-4819-ba20-f4953479e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:42.308889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafb4be-34ee-4819-ba20-f4953479e5c7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:42.317726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 3/6] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:42.326092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:42.326537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:42.326684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:42.349209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:42.350874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:42.360361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 01 09:49:42.385929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafb4be-34ee-4819-ba20-f4953479e5c7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:42.401722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafb4be-34ee-4819-ba20-f4953479e5c7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:42.408178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:42.408836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:42.409119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:42.409403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:42.418146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:42.419956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643cebb-656e-4ef7-97aa-43a6ed041141 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:42.429343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1324 bytes} [Fri Apr 1 09:49:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 09:49:42.435360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:42.448189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038d4b-7f49-47d7-94f3-4c228eedb90f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:42.454674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:42.455576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:42.455863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:42.456141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:42.457777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:42.459699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f37cf6-5fcf-471b-82e3-c671d3b09153 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:42.461268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 5/9] 10.222.0.46 () {56 vars in 1198 bytes} [Fri Apr 1 09:49:42 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:44.787075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d950-57b0-4c5e-85c9-f3c9fbe9d2a4 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:44.787609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d950-57b0-4c5e-85c9-f3c9fbe9d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:44.787609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5d950-57b0-4c5e-85c9-f3c9fbe9d2a4 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:44.789358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:44.793690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab586-8b59-41a5-9268-afdcb2b6ceb7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:44.794133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab586-8b59-41a5-9268-afdcb2b6ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:44.794225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:44.794304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab586-8b59-41a5-9268-afdcb2b6ceb7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:44.794512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:44.794817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:44.796258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 6/11] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:44.801597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:44.801886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:44.802164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:44.819269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:44.820533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:44.836846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG passlib.handlers.bcrypt [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79776) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 01 09:49:44.837264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG passlib.handlers.bcrypt [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79776) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 01 09:49:44.883392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:44.885044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:44.897032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:49:44.919821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:44.982016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 6/13] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:45.005084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.019180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda0fca-15a3-429e-9225-f6ababb13d6d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.052348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.052902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.053215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.053482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.101262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df91e06-8f31-46fd-bb9a-3bb715b022e1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.121815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.123392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.135100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.136160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.136449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.136706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.148826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:49:45.155968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:49:45.157783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 7/14] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:49:45.163609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.218510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:49:45.224530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.258479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d62b-cd48-477b-9292-f0a5ab9278e4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.291792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.292453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.292737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.293011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.293766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:45.294070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.295551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.307277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 8/16] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:45.312833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.316837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6337bc-cbad-4267-9c62-ca42737e9547 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.348123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.348931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.349757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.350049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.360434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.361926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.378022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:49:45.379239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 9/17] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:49:45.384941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.409456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b425c-d1f1-4fe2-9d2e-9e3baff055fb None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.444302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.445296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.445585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.445857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.447555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.449051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.450743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 9/18] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:45.456493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.484366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afc0d-3805-41cc-bec2-4dbea811f636 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.517358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.518028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.518313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.518587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.519348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:45.519655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.521058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.537959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 10/19] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:45.558898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bc695-3df3-491f-a9d3-f78a0c49b1f0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.595742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.596571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.596859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.597138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.598484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.600048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42378f-8ea5-4f20-9ade-14d8ef818d62 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.601789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 10/20] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:45.607982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:45.713096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5186b-2bac-4390-9a87-e96c2da202d0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:45.749157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:45.749852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:45.750131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:45.750427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:45.751710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.domain.id=default, user.id=763b9bb9696f4539b6048050128f2089) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:45.752165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:45.754413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3479884-8092-48cc-8530-3eca502c50d4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:45.761392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 11/21] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Apr 1 09:49:45 2022] GET /identity/v3/role_assignments?user.id=763b9bb9696f4539b6048050128f2089&scope.domain.id=default&role.id=f9d36af787804f248e9bea8324501c2a => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:48.122401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058d35-432b-4f58-8d3d-186b895512df None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.123520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058d35-432b-4f58-8d3d-186b895512df None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.124026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af058d35-432b-4f58-8d3d-186b895512df None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.126315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 11/22] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:48.131389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.132280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.132921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.155862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:48.157724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:48.233577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:48.264946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af058d35-432b-4f58-8d3d-186b895512df None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:48.381808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af058d35-432b-4f58-8d3d-186b895512df None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:48.415875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:48.417046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.417524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.418004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.436983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:48.438830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:48.456544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:49:48.458569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 12/24] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:49:48.464255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:48.561101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68e7b-2906-41cd-9873-e2c763bdd3fc None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:48.594896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:48.595595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.595884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.596164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.596898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:48.597204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:48.598613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3843295-be4d-4c9f-8a6a-532c0c7846cb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:48.610871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 13/25] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:48.616046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:48.712045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bb5-60a3-4c51-876f-6d74392aea47 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.712993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bb5-60a3-4c51-876f-6d74392aea47 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.713466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bb5-60a3-4c51-876f-6d74392aea47 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.716107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 14/26] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:48.723001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00057af-dc9c-47cb-91e4-c2c80d8deca4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.723520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00057af-dc9c-47cb-91e4-c2c80d8deca4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.723985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00057af-dc9c-47cb-91e4-c2c80d8deca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.750742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c00057af-dc9c-47cb-91e4-c2c80d8deca4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:48.752348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c00057af-dc9c-47cb-91e4-c2c80d8deca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:48.767751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d44cc-885c-445e-8648-e3cc372fd737 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:48.801657 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:48.802326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.802793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.803230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.804069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:48.805733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:48.820150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 15/27] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:49:48.825835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68399-7146-4302-aa04-1a36c79757e7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.826069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68399-7146-4302-aa04-1a36c79757e7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.826324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be68399-7146-4302-aa04-1a36c79757e7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.828861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 16/28] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:48.829871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494888f-ab29-44d0-87d8-5da89188b884 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.830212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494888f-ab29-44d0-87d8-5da89188b884 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.830417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494888f-ab29-44d0-87d8-5da89188b884 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.834728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 17/29] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:48.836358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193eaf1-4eb0-4b80-8afc-05f4146bb0dd None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.836867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193eaf1-4eb0-4b80-8afc-05f4146bb0dd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.837387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193eaf1-4eb0-4b80-8afc-05f4146bb0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.867722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6193eaf1-4eb0-4b80-8afc-05f4146bb0dd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:48.869255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6193eaf1-4eb0-4b80-8afc-05f4146bb0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:48.935442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 18/30] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:48.937087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:48.937582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:48.938059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:48.958596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:48.960134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:48.964238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 13/31] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:49:48 2022] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:49:48.964490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.032056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 19/32] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:49.033360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.131078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df36526-2576-4aa0-a0fa-725ef601df5e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.135156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3692c6-3fa6-473c-af77-4018dc04b1e4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.172096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.173161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.173667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.174132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.175147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:49.176789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:49.179496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.180346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.180630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.180908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.211759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:49:49.219003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:49:49.222872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 14/33] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:49:49.223794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.323018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 20/34] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Apr 1 09:49:49 2022] POST /identity/v3/roles => generated 225 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:49:49.324379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.390727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0fbde-314b-42ad-a398-10279cf86f26 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.437505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.438592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.439149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.439624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.441432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:49.446010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:49.476809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 15/35] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Apr 1 09:49:49 2022] POST /identity/v3/roles => generated 219 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:49:49.527169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae0102-065b-4ff6-a517-c2b33d81c7f9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.584488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.585246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.585590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.585964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.586780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:49.587102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:49.588730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:49.603769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 21/36] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:49.609120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.726434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006a6af-d7c4-4fdf-b579-ab429f29a542 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.761711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.763017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.763504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.763989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.765453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:49.767179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ee85e-1f43-4630-8077-98db11920bda None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:49.769371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 16/37] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:49:49 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:49.774985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.851893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9177-6eb1-48a1-9791-b11e911cd708 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.852228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9177-6eb1-48a1-9791-b11e911cd708 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.852454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a9177-6eb1-48a1-9791-b11e911cd708 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.854295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 17/38] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:49:49.860216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.860728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.861204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.878939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:49.880724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:49.883622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdb3a5-10ce-4a12-85d5-1b86ce6a0cdf None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:49.916732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:49.917542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:49.917829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:49.918108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:49.919436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:49.920900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:49.922505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 22/39] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:49.928012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:49.950569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 18/40] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:49:49.972874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:50.021173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceed858-1e6c-44ae-9d31-1748313f4d0d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:50.054628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:50.055485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.055750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.056034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] PATH_INFO: `/v3/domains/default/users/763b9bb9696f4539b6048050128f2089/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.058136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=763b9bb9696f4539b6048050128f2089, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:50.059917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca243c-101c-411c-b881-6f52540f75ca None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:50.074193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7d9ad-be9b-493d-bc05-01494b1f3849 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:50.076483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 23/41] 10.222.0.46 () {58 vars in 1361 bytes} [Fri Apr 1 09:49:49 2022] PUT /identity/v3/domains/default/users/763b9bb9696f4539b6048050128f2089/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:49:50.111577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:50.112301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.112642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.112927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.113701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:50.115197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16945b1c-b312-49b1-8fbe-354e170c0e34 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:50.132590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 19/42] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Apr 1 09:49:49 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:49:50.207597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5c6-a4e4-40e3-bdac-160d0b3b3b10 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.208152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5c6-a4e4-40e3-bdac-160d0b3b3b10 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.208152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606e5c6-a4e4-40e3-bdac-160d0b3b3b10 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.210267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 24/43] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:50.216627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.217006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.217191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.236559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:50.237914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:50.314804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 20/44] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:50.337786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606e5c6-a4e4-40e3-bdac-160d0b3b3b10 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:50.440122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606e5c6-a4e4-40e3-bdac-160d0b3b3b10 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:50.474120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:50.474976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.475266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.475547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.476790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:50.478257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa802-109c-4d57-9dc8-2da3fcff57ce None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:50.479951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 25/45] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:50.486064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:50.591752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1593b5-a3e0-40e2-b7f5-cb2bcf1f6b48 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:50.627422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:50.628097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:50.628385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:50.628693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:50.629428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:50.630960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31d510-226b-4ac1-8953-32d79baae67e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:50.659852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 21/46] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:49:50 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:49:52.355193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113b57-23ae-47e3-ab83-f38d10345b95 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.355745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113b57-23ae-47e3-ab83-f38d10345b95 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.355745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113b57-23ae-47e3-ab83-f38d10345b95 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.357516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 26/47] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:52.362956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.363393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.363476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.381315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:52.382945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:52.452890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 22/48] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:52.476832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113b57-23ae-47e3-ab83-f38d10345b95 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:52.585498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113b57-23ae-47e3-ab83-f38d10345b95 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:52.621382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:52.622090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.622373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.622664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.634443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:49:52.641392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:49:52.642605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 27/49] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:49:52.648719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:52.746246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2ef37-6991-49a0-a67d-733abe5060e9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:52.780095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:52.780786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.781071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.781346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.782477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:52.782818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:52.784237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2445ac-2ee6-413e-a63a-585c28028d09 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:52.792652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 23/50] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:52.798619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:52.897018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46746637-3aea-42fe-8bc5-6807d7fee635 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:52.924563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80602-bbee-4e74-b87a-e084ca490f98 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.924846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80602-bbee-4e74-b87a-e084ca490f98 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.925130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80602-bbee-4e74-b87a-e084ca490f98 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.926914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 24/51] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:49:52.931651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:52.931960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.932258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.932538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:52.932634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.932824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:52.933102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:52.934302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:52.935814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:52.937456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 28/52] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:49:52 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:52.942722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:52.950371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:52.951639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:53.016276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 25/53] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:53.037886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966e785-b334-4d6a-8634-7b9ea5b4a4d9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:53.039693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:53.069640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:53.070481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:53.070805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:53.071087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:53.072297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:53.073827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:53.075458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 29/54] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:53.081099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:53.135270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9ea9a-0827-4d3f-b1b7-4778fe183919 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:53.169484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:53.170218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:53.170505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:53.170821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:53.172029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:53.173485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:53.174301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd870be2-6be8-4010-b945-88c4d22a362b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:53.175103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 26/55] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:53.180760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:53.217677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:53.218351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:53.218641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:53.218940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:53.219772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.domain.id=default, user.id=763b9bb9696f4539b6048050128f2089) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:53.220084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:53.221562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e277132-e903-48fc-ac29-fee8c6b4216e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:53.227262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 30/56] 10.222.0.46 () {56 vars in 1322 bytes} [Fri Apr 1 09:49:53 2022] GET /identity/v3/role_assignments?user.id=763b9bb9696f4539b6048050128f2089&scope.domain.id=default&role.id=f9d36af787804f248e9bea8324501c2a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:53.285954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd56e1-bfd0-4825-9bcf-53e875bb28aa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:53.323234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:53.323927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:53.324220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:53.324486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:53.325246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:53.326767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ce64-bafc-4b94-b2ae-d9f38c6eca1c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:53.355531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 27/57] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Apr 1 09:49:53 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:49:55.623741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd120-624b-48bd-872d-15712fc67449 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:55.624313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd120-624b-48bd-872d-15712fc67449 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:55.624313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd120-624b-48bd-872d-15712fc67449 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:55.626117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 31/58] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:55.631663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:55.632100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:55.632206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:55.650500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:55.651765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:55.721956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 28/59] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:55.753901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd120-624b-48bd-872d-15712fc67449 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:55.859001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd120-624b-48bd-872d-15712fc67449 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:55.895240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:55.896009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:55.896290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:55.896563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:55.897928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:55.899379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a9d7-8e28-4f90-8909-03c94376b794 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:55.900941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 32/60] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:49:55.907713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:56.016380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7162e-9982-4ab9-bbd9-98779ebf181b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:56.050517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:56.051200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:56.051483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:56.051709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:56.052484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:56.053928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689e990-10f8-4677-bfd0-d8cd6e617037 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:56.084051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 29/61] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:49:55 2022] POST /identity/v3/users => generated 275 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:49:59.258623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411bb97-a26a-41b6-b2c3-6f9094afbd64 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.259717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411bb97-a26a-41b6-b2c3-6f9094afbd64 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.260200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411bb97-a26a-41b6-b2c3-6f9094afbd64 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.262575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 33/62] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:59.267641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f202-5108-4de2-a7c5-ae8db178c216 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.268435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f202-5108-4de2-a7c5-ae8db178c216 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.268913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f202-5108-4de2-a7c5-ae8db178c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.294622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-04f9f202-5108-4de2-a7c5-ae8db178c216 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:59.296288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-04f9f202-5108-4de2-a7c5-ae8db178c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:59.381064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 30/63] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:59.416249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411bb97-a26a-41b6-b2c3-6f9094afbd64 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:59.553476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411bb97-a26a-41b6-b2c3-6f9094afbd64 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:59.600293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:59.601557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.602039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.602518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.617434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:49:59.619693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7a633-69cd-4932-8a32-a408a92f2115 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.620237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7a633-69cd-4932-8a32-a408a92f2115 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.620702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7a633-69cd-4932-8a32-a408a92f2115 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.622914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 31/64] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:59.626563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:49:59.627856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 34/65] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:49:59.628735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e23-eefd-4ba2-8212-d2b5e0eeeb12 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.629209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e23-eefd-4ba2-8212-d2b5e0eeeb12 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.629669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e51e23-eefd-4ba2-8212-d2b5e0eeeb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.635470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:59.662389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e1e51e23-eefd-4ba2-8212-d2b5e0eeeb12 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:59.663701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e1e51e23-eefd-4ba2-8212-d2b5e0eeeb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:59.765485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 32/66] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:49:59.767174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783e15-0952-44e3-b621-2fe6e93fb8fd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.767603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783e15-0952-44e3-b621-2fe6e93fb8fd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.768016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783e15-0952-44e3-b621-2fe6e93fb8fd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.774063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 33/67] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:49:59.775434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.775864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.776278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.777159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0827fa-8823-45e4-8ce3-d70db8364a5c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:59.801939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:49:59.804225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:49:59.814390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:59.815302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.816028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.816605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.817644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:49:59.818283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:49:59.820553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:49:59.832365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 35/68] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:49:59.833642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:59.882763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:49:59.884694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:49:59.960794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f5d-afbb-43a3-9ea1-8767f3d4d0e9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:49:59.994477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:49:59.995698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:49:59.996237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:49:59.996710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:49:59.997135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5127273-771a-469c-bbbc-477b80082c4d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.007792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:00.015059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:00.016510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:00.017568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.032380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.033644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.033935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.034525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.053147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.055348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.058100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:49:59 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.058781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.134313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490a7b-17fa-4950-9906-a9ba86b6aa1c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.168326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.169252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.169602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.169947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.177959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d379-1ec2-462f-9434-51f4c488ba51 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.184594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:00.194259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:00.196099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:00.196897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.215766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.216446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.216733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.217010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.217761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:00.218066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.219496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.228416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.229226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.299028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae37c0-4275-44ac-8e48-c0bd53cfe10b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.323489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ea5e-cb4d-43c3-9d97-0d33dd7d04ad None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.329206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.329862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.330139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.330413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.356149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.356842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.357144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.357426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.358201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:00.358513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.359969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7160b-dd0d-45dc-aa23-2ca82917c7b3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb736d-e0b2-4d47-a879-8326646ac512 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb736d-e0b2-4d47-a879-8326646ac512 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb736d-e0b2-4d47-a879-8326646ac512 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 38/75] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:00.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb736d-e0b2-4d47-a879-8326646ac512 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.394078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.395593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5e061-d439-4f77-94ca-b34c5c35061b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.472936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb736d-e0b2-4d47-a879-8326646ac512 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.488413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 38/76] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:00.489966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6f1e-2a65-4b9c-821f-a806aca8b72a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.490257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6f1e-2a65-4b9c-821f-a806aca8b72a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.490531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6f1e-2a65-4b9c-821f-a806aca8b72a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.492261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 39/77] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:00.492964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6f1e-2a65-4b9c-821f-a806aca8b72a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.510708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.511608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.511890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.512164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.513345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.514829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377278-ef06-486a-b0fe-5432d0302cf2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.516452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 39/78] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.518734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.519033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.519318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.535572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:00.536777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:00.587223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6f1e-2a65-4b9c-821f-a806aca8b72a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.598168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 40/79] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:00.599914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.619899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.620837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.621136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.621581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.622939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.624434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25542d-0856-4493-8e05-1c79c52d00d2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.626081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 40/80] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.627380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.627675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.627959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.645039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:00.646595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:00.693790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191eb7e-27b2-48a0-be1c-63d13b5a3629 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.712577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:00.714194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.727039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.727928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.728213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.728487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.729686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.731200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.732902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 41/82] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.733667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.812785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfcec0-e6a3-4c0e-9b2f-6b4b7eaa33d3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.827038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940c8f0-0084-47e8-899a-c45535f11c6f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.844991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.845573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.845858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.846185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.858796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.859603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.859889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.860167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:00.861387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.862879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.864673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 42/83] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:00.865334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:00.911568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:00.913072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:00.960893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68dccc-6981-46cf-b45a-fdc955b0b03e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:00.994601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:00.995276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:00.995562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:00.995838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.004036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 42/84] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:01.004919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.058690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.060210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.102948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9742b6-8176-406d-9a65-3b6511d31290 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.133760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.134569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.134885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.135174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.145205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:01.152251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:01.153627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 43/85] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:01.153990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 43/86] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:01.154362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.154836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.248355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8c71-50c4-40fd-96e1-90d49806cd87 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.249860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a19-45cc-4d5d-87da-061b20564c5f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.280002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.280668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.280954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.281231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.282425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:01.282535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.282764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.283140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.283427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.283702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.284241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.284436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.285873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.289515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 44/87] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.290297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.306948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 44/88] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:01 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:01.312265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.401731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7d5e-f2ec-4795-ab7b-4db980f46f5c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.429886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9bd70-3a3d-43af-bd1b-8a13b20de9f5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.438264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.439315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.439600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.439890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.441221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.442786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.444841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 45/89] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.450610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.475670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.477105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.477667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.478137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.479849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.481641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.484100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 45/90] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.485352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.571678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b01727-00a2-4448-a83c-111f1c0833c7 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.603143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4227-0bc2-4ad3-9be8-8ee4f658371c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.623778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.623999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.624363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.624855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.625620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:01.625932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.628838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.639444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 46/91] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.641231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.652600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.653216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.653511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.653789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.654636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=763b9bb9696f4539b6048050128f2089) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:01.655000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.656912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.665577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 46/92] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/role_assignments?user.id=763b9bb9696f4539b6048050128f2089&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.666425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.749151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec4313-6e87-401d-b029-70ae9e51e9fc None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.772260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4564b0-7882-406e-8403-7f6174a4d68d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.785417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.786441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.786929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.787379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.788428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:01.788916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.790601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.797004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 47/93] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=ec45838429e4491ea0215d21e1e01239 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.812752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.813688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.813974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.814252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:01.815631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:01.817259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:01.819313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 47/94] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:01.825178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:01.938733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5967f-3bd0-4dc6-a55f-3603cd43e587 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:01.974542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:01.975530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:01.976053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:01.976527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:02.052973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:02.054845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:02.176620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 48/95] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:02.182476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:02.289734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da7e9e-67e6-4785-b3f7-ca206fec1f5b None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:02.330852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:02.331734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:02.332013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:02.332286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] PATH_INFO: `/v3/projects/df4e0af2c4d748079caf4176061be8c9` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:02.339366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] RBAC: Authorizing `identity:get_project(project_id=df4e0af2c4d748079caf4176061be8c9)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:02.340819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6166e-2a33-4160-9b5c-a3507c7f7964 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:02.342523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 48/96] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:02 2022] GET /identity/v3/projects/df4e0af2c4d748079caf4176061be8c9 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:02.348579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:02.491097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b837-3175-4fc4-bc6a-b2313d584ab5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:02.525334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:02.526386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:02.526893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:02.527362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:02.528398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=df4e0af2c4d748079caf4176061be8c9, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:02.528900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:02.530534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e33e2-5a22-4e21-9807-5e5b64ad50f0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:02.536970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 49/97] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:02 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=df4e0af2c4d748079caf4176061be8c9&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:04.259853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6fce-64e1-4e7f-b5fe-cd074b68162b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.260433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6fce-64e1-4e7f-b5fe-cd074b68162b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.260433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c6fce-64e1-4e7f-b5fe-cd074b68162b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.262273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 49/98] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:04.268292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.269237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.269714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.293112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:04.294721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:04.373590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 50/99] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:04.412994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c6fce-64e1-4e7f-b5fe-cd074b68162b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:04.536395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c6fce-64e1-4e7f-b5fe-cd074b68162b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:04.578089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:04.578936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.579218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.579495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.596147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:04.608392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-22b88718-304c-4092-bb40-c7e1f7263b93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:04.609714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 50/100] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:04.615671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:04.745442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd762339-fd8c-451f-93e3-7f27624e37b4 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.745871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd762339-fd8c-451f-93e3-7f27624e37b4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.745988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd762339-fd8c-451f-93e3-7f27624e37b4 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.747837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 51/101] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:04.751229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049ea95-2b99-4fcc-aa19-76bea58c32f6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:04.753152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.753442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.753721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.786927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:04.787669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:04.788232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:04.788720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:04.788953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:04.789387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:04.790335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:04.790896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:04.792495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:04.801397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 51/102] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:04.810342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:04.916245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 52/103] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:04.947500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:04.972099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058cca7-23e3-4a01-9093-745ebb51ed17 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.020615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.021902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.022382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.022942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.024431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:05.026133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:05.028353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 52/104] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:04 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:05.034189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.113268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b186450-e3f7-403d-8b1e-638267a20892 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.132754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58c80e-d7e5-4d5a-b78f-fdbdd8a0c2ae None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.167317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.168572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.169058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.169554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.171005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:05.172733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:05.174703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 53/105] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:05 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:05.180902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.182983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.185926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.186418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.187112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.191372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:05.194760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fa8ff-d709-4261-950a-0a941effcb18 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:05.199839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 53/106] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:05.202100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202601b-a51d-412c-a80c-559b775c0201 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.202633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202601b-a51d-412c-a80c-559b775c0201 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.203137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202601b-a51d-412c-a80c-559b775c0201 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.205270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 54/107] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:05.206895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202601b-a51d-412c-a80c-559b775c0201 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.333273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a243e-c61e-4944-8490-273d69a648e2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.378285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.379154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.379437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.379717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.383644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, user_id=caee3a5e3ad64991b0c7b600ebf4de14, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:05.385134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7ac5-54d0-4f88-a334-25926c88588a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:05.407814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 54/108] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:05 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:50:05.409134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.409425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.409706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.449590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:05.451431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:05.455782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202601b-a51d-412c-a80c-559b775c0201 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.519539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.520057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.520345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.520626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.521351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:05.522951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd36429-ad26-4d13-9f34-27f61031a1cd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:05.538027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 55/109] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:05.580875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 55/110] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:50:05 2022] POST /identity/v3/projects => generated 302 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:05.589844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.605899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade0f6-cd99-48cf-8ba6-7efacd8592e0 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.606780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade0f6-cd99-48cf-8ba6-7efacd8592e0 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.606780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade0f6-cd99-48cf-8ba6-7efacd8592e0 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.608373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 56/111] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:05.614950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885dc95-56ae-4f58-b75b-28df9215c52d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.615271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885dc95-56ae-4f58-b75b-28df9215c52d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.615482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885dc95-56ae-4f58-b75b-28df9215c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.639074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c885dc95-56ae-4f58-b75b-28df9215c52d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:05.642479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c885dc95-56ae-4f58-b75b-28df9215c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:05.773062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 57/112] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:05.774469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df14-049e-49a4-9004-c5d7fda5cd81 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.774835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df14-049e-49a4-9004-c5d7fda5cd81 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.775120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df14-049e-49a4-9004-c5d7fda5cd81 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.776856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 58/113] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:05.781114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16116f8c-796d-4be5-a3f0-6de95f6de08e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:05.784362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.784654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.784934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.809524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:05.810832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:05.831567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:05.832414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.832701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.832984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.844401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:05.851956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-17e111b1-7a0d-489f-b97b-ccf860fc0d1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:05.853243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 56/114] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:05.854562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc008-29d2-4707-bc6a-6d14937da01f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:05.854881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc008-29d2-4707-bc6a-6d14937da01f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:05.855225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bc008-29d2-4707-bc6a-6d14937da01f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:05.858302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 57/115] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:05.859088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bc008-29d2-4707-bc6a-6d14937da01f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.900000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 59/116] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:05.900889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:05.976912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bc008-29d2-4707-bc6a-6d14937da01f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.015644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e646f5c-df8e-4d5e-9b15-1442643217f9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.019827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.020871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.021460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.021944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.035233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:06.044855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-3381deb2-912f-4563-9cc1-b95d809c521b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:06.047093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 58/117] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:06.048516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.049021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.049499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.055104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.055950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.056241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.056525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.058181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:06.058495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.060002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.069180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 60/118] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.069894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:06.070147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.071628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:06.151140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 59/119] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:06.152325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.198951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372cdf1-48e7-42cb-850d-855c54967616 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.238761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.239579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.239868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.240148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.258032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:06.266940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:06.268634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 61/120] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:06.269761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.276145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042836-9484-4f56-9829-76d57439fc61 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.310277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.311405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.311909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.312441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.313443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:06.313963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.315630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.324205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 60/121] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.325318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.373376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53980d68-abdb-4943-ab84-191afad8ab2a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.408861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.409809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.409998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.410233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.411535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.413018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.414905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 62/122] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.415606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.426290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5360c-4392-49b9-bf0e-2971fa509f1c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.460430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.461630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.462114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.462580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.478750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:06.486230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:06.492862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 61/123] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:06.493984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.523633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410c73-651e-4b8b-a9fb-fe6e4cbf1c65 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.558490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.559209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.559498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.559779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.560534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:06.560844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.562303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.571541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 63/124] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.572658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.597690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fc2aa-36d5-4146-804b-170ff9bbb974 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.631542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.632841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.633333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.633759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.635135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.636816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.638700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 62/125] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.639695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.671815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd14aa-201b-446b-8521-0bf916902a05 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.704770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.706030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.706030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.706225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.707437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.708891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.711059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 64/126] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.711525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.742949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6feb7-fb9a-4ce9-8217-282f0e99a6d2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.776816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.777926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.778427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.778988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.780013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:06.780543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.782590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.791624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 63/127] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.792835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.818442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1925-8858-4205-9b57-ead7549265ad None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.852125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.852994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.853303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.853611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.854790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.856260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.858229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 65/128] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.859137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.896554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d2392-a47a-4f6f-bfdb-03c57abed0a9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.930122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.931361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.931846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.932393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] PATH_INFO: `/v3/projects/df4e0af2c4d748079caf4176061be8c9` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.933818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=df4e0af2c4d748079caf4176061be8c9)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.935547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:06.937451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 64/129] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/projects/df4e0af2c4d748079caf4176061be8c9 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:06.938410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:06.956826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2964-740f-4e9d-8798-8f2b5758fe51 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:06.989785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:06.990982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:06.991092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:06.991388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:06.993662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, user_id=caee3a5e3ad64991b0c7b600ebf4de14, role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:06.995192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.015261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 66/130] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:06 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/ec45838429e4491ea0215d21e1e01239 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:07.016719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:07.058968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6edc16-f4ea-49d1-b9cc-33ecdf3fc8e9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.137274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d891570-f060-4672-8471-95ae53eacd4d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.151385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.152290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.152572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.152841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] PATH_INFO: `/v3/users/1e523a8d471b45069224472374847aed` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.170932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] RBAC: Authorizing `identity:get_user(user_id=1e523a8d471b45069224472374847aed)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.172412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.174448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 65/131] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:06 2022] GET /identity/v3/users/1e523a8d471b45069224472374847aed => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:07.175264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:07.181640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.182479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.182792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.183228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.185536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.187489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.189881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 67/132] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:07 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:07.190792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:07.306676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82bcef-3c95-44dc-854e-1e98c884c1b5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.334207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b34b13-beef-4e66-84a5-eb99d79c083e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.347383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.348202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.348494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.349127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.368485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.369449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.369737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.370013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] PATH_INFO: `/v3/projects/df4e0af2c4d748079caf4176061be8c9/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.372050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] RBAC: Authorizing `identity:create_grant(project_id=df4e0af2c4d748079caf4176061be8c9, user_id=caee3a5e3ad64991b0c7b600ebf4de14, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.373500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.401730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 66/133] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:07 2022] PUT /identity/v3/projects/df4e0af2c4d748079caf4176061be8c9/users/caee3a5e3ad64991b0c7b600ebf4de14/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:07.402562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:07.435394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.437425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.513598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def912b-71b9-4b7f-9474-5c6a91a27909 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.582949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.584255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.584740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.585292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/763b9bb9696f4539b6048050128f2089/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.594679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, user_id=763b9bb9696f4539b6048050128f2089, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.594886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:07.597052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.600198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:07.629602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:07 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/763b9bb9696f4539b6048050128f2089/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:07.746166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8178160-affb-4f78-a7ea-9e6a155a3b38 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:07.790513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:07.791477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:07.791762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:07.792040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:07.799774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:07.801303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2612f4f-739e-4d3b-b965-0e69517d5548 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:07.803213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 69/136] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:07 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:07.810379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:08.019203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d938-7e1e-4da3-9d93-bda954440ae6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:08.054917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:08.055596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.055890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.056165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.057013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=1e523a8d471b45069224472374847aed) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:08.057398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:08.058910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd1ddc-3118-4d8e-a99c-78e446cc23d1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:08.071090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 68/137] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:07 2022] GET /identity/v3/role_assignments?user.id=1e523a8d471b45069224472374847aed&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:08.250905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe647-664e-486b-832f-340f2cbd34d7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.251613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe647-664e-486b-832f-340f2cbd34d7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.252095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fe647-664e-486b-832f-340f2cbd34d7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.254085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 70/138] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:08.260018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b1b-989b-4895-a2c8-234e0fb3c1d8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.260316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b1b-989b-4895-a2c8-234e0fb3c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.260604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d85b1b-989b-4895-a2c8-234e0fb3c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.283419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-23d85b1b-989b-4895-a2c8-234e0fb3c1d8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:08.284534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-23d85b1b-989b-4895-a2c8-234e0fb3c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:08.374508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 69/139] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:08.410593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe647-664e-486b-832f-340f2cbd34d7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:08.426675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f91a-7dc7-460f-ab4b-b702cff7b4d8 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.427004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f91a-7dc7-460f-ab4b-b702cff7b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.428693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f91a-7dc7-460f-ab4b-b702cff7b4d8 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.429645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 70/140] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:08.437582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.437878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.438163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.457302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:08.458581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:08.603880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fe647-664e-486b-832f-340f2cbd34d7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:08.616153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 71/141] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:08.652980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:08.662371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:08.663342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.663631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.663912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.687545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:08.694736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:08.696313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 71/142] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:08.702551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:08.844337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcbcd-5d8a-4161-8eb7-4b7aec0168a6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:08.870997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69bd94-7f1e-4386-812c-dfb564e1b1fd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:08.906181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:08.907415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.907698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.907974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.910414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:08.911927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:08.913663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 72/143] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:08.919118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:08.932806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:08.933494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:08.933781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:08.934060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:08.934845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:08.935159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:08.936546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:08.953903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 72/144] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:08.960278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:09.077313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b75ec-348a-403e-819b-3df4838172a5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:09.141624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:09.142327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:09.142620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:09.142930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:09.143687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:09.145163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:09.165270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fdcf8-0f57-4d17-a74d-3d00ab579628 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:09.180897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 73/145] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:08 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:09.237480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81768-a215-4587-a049-737551da0198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:09.238401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81768-a215-4587-a049-737551da0198 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:09.238704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81768-a215-4587-a049-737551da0198 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:09.238984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e81768-a215-4587-a049-737551da0198 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:09.242011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81768-a215-4587-a049-737551da0198 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:09.243620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e81768-a215-4587-a049-737551da0198 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:09.245326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 73/146] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:08 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:09.250935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:09.375754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7074cc-c55c-4832-b696-11a34c1aea22 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:09.411613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:09.412202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:09.412495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:09.412780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:09.486156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:09.492701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:09.596893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 74/147] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:09.603291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81768-a215-4587-a049-737551da0198 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:09.737824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e81768-a215-4587-a049-737551da0198 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:09.777060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:09.777936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:09.778220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:09.778496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:09.780116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:09.781923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9e47-7afd-4f9d-95e8-d08c0eca2b0c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:09.784023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 74/148] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:09 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:09.790264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:09.915837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f61c-e793-46b0-9fc0-d6eb0b95127e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:09.952492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:09.953173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:09.953465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:09.953750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:09.954596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:09.954938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:09.956407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d5a46-db2c-4af5-aeef-1f7530b2c3f8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:09.962699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 75/149] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:09 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:10.284927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103133-f2e5-4926-8459-211c1c82e176 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.285251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103133-f2e5-4926-8459-211c1c82e176 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.285492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a103133-f2e5-4926-8459-211c1c82e176 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.287311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 75/150] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:10.294180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.294469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.294784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.312832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:10.314011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:10.387746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 76/151] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:10.415033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103133-f2e5-4926-8459-211c1c82e176 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:10.550304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a103133-f2e5-4926-8459-211c1c82e176 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:10.588116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:10.588971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.589265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.589552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.600793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:10.608318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:10.609752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 76/152] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:10.615581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:10.725587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d76e-0578-4425-a93b-738a99cd05d8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:10.762738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:10.763435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.763726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.764003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.764775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:10.765079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:10.766490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2854-db48-43d1-bc3c-cb01b34341f2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:10.775717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 77/153] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:10.780984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:10.886325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e53ad-e696-4362-b3a8-ddc4cfb2cc88 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:10.922806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:10.923199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884400-3b6e-4c8e-9aa4-bd34013935a7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.923760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.924054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.924337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.924653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884400-3b6e-4c8e-9aa4-bd34013935a7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.925247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884400-3b6e-4c8e-9aa4-bd34013935a7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.925622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:10.927409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:10.928493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 78/154] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:10.929184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 77/155] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:10 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:10.934168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:10.934577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:10.935077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:10.935568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:10.957101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:10.959290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:11.035091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 79/156] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:11.063352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:11.086180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183014e3-4ae6-4a15-a1a3-e06ac9664701 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.126638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.127578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.127693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.127941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.190495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66790a6-5c75-4f41-ab48-bf315cf3c324 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.247498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:11.248982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2304b84-2268-4c6c-bd65-3561b72a39c5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:11.275768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.276604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.276881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.277149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.301844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:11.320099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:11.321376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 80/157] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:11.329034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:11.442002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 78/158] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:11.443313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c899a-0e15-40bb-82ac-94b230b6827f None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.443603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c899a-0e15-40bb-82ac-94b230b6827f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.443881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c899a-0e15-40bb-82ac-94b230b6827f None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.445729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 79/159] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:11.450755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c899a-0e15-40bb-82ac-94b230b6827f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:11.510261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de45c57-6250-42b9-9d3b-f72149bd1f46 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.575401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.576098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.576381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.576660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.577422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:11.577730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:11.579174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8168b-fdcb-4136-92e4-772ff27db524 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:11.598239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 81/160] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:11.602669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.602669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.602669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.603346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c899a-0e15-40bb-82ac-94b230b6827f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.638663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.639634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:11.639991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.640411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.640832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.640939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:11.642246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:11.643881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae259892-e849-43cb-81da-71281728cd0a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:11.646050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 80/161] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:11.647572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a11dd-178e-4fc3-bba2-89fb88e8e776 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.647996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a11dd-178e-4fc3-bba2-89fb88e8e776 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.648438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a11dd-178e-4fc3-bba2-89fb88e8e776 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.650231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 81/162] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:11.651188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a11dd-178e-4fc3-bba2-89fb88e8e776 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:11.768660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a11dd-178e-4fc3-bba2-89fb88e8e776 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.781103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 82/163] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:11.782360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:11.837706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.838602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.838923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.839198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] PATH_INFO: `/v3/users/caee3a5e3ad64991b0c7b600ebf4de14` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.843368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=caee3a5e3ad64991b0c7b600ebf4de14)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:11.844902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f28f82-eb4e-4cf3-8440-ae49f938c2c0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:11.846603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 82/164] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/users/caee3a5e3ad64991b0c7b600ebf4de14 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:11.847776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.848049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.848371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.879051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:11.880251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:11.903313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cd340-2d68-4592-bce3-31c4bb082fd2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:11.936651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:11.938031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:11.938449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:11.938882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:11.939847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:11.940296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:11.941902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:11.948208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 83/165] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=ec45838429e4491ea0215d21e1e01239 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:11.950921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.050753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 83/166] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:12.050753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.060813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe49915-054d-48c7-944a-252a7e51f620 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.099428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.100660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.101137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.101598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.112958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:12.120592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:12.122182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 84/167] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:12.123444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.227038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc42ec-0dbb-4dba-a7be-52ab6a5a176b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.261562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.262839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.263353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.263816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.275451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:12.280828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3617-1b69-4f31-a040-f4bf2d08fa4d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.283491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:12.284983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 85/168] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:12.286024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.371496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.372080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.372506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.372915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.386908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70086585-f33e-4eeb-adca-0278f19ffbfe None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.420819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.422073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.422549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.423058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.424000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:12.424513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.426106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.435339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 86/169] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:12.436775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.523723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.525225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.549511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7329242-4a5d-4d70-9784-8740e45e8c9e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.583400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.584424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.584999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.585477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.586496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:12.587105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.588778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.597569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 87/170] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:12.598860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.696092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64160bdf-6d93-4791-89c4-e0982f24b4f4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.698041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 84/171] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:12.699156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.730117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.731449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.731951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.732426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] PATH_INFO: `/v3/users/763b9bb9696f4539b6048050128f2089` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.733823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] RBAC: Authorizing `identity:get_user(user_id=763b9bb9696f4539b6048050128f2089)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.735593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.737465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 88/172] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/users/763b9bb9696f4539b6048050128f2089 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:12.738556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.799453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91765e-123e-40bb-b1e1-4554051ae43d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.832238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.833121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.833397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.833672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] PATH_INFO: `/v3/users/1e523a8d471b45069224472374847aed` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.834953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] RBAC: Authorizing `identity:get_user(user_id=1e523a8d471b45069224472374847aed)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.836435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.837843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0bdca-629e-42d9-a4c4-170007b935f5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.838069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 85/173] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/users/1e523a8d471b45069224472374847aed => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:12.838922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.883667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:12.884904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:12.885405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:12.886231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] PATH_INFO: `/v3/projects/df4e0af2c4d748079caf4176061be8c9` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:12.888105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=df4e0af2c4d748079caf4176061be8c9)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:12.890468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:12.893091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 89/174] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/projects/df4e0af2c4d748079caf4176061be8c9 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:12.894201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:12.958562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4bfcd-5fb7-489a-acc5-2974513eccb6 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:12.994679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6ccd8-79cc-41e1-a98b-961bffb11fb6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.001687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.002852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.003338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.003778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.034349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.035272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.035553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.035823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.038133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:13.039630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:13.041544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 90/175] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:13.042091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:13.198688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:13.198688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c94e98-c13c-42e4-a178-5b45910205cc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:13.202883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95864a6-e2fb-49c4-bf4f-d6f22a8c799b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.273488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.274073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.274354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.274628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.275483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=df4e0af2c4d748079caf4176061be8c9, user.id=caee3a5e3ad64991b0c7b600ebf4de14) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:13.275789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:13.284274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:13.297192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 91/176] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:13 2022] GET /identity/v3/role_assignments?user.id=caee3a5e3ad64991b0c7b600ebf4de14&scope.project.id=df4e0af2c4d748079caf4176061be8c9&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:13.297830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:13.440824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 86/177] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:13.442823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446157-690d-4bff-bc16-eb40ed15273b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.443325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446157-690d-4bff-bc16-eb40ed15273b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.443832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc446157-690d-4bff-bc16-eb40ed15273b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.445882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 87/178] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:13.450983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc446157-690d-4bff-bc16-eb40ed15273b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:13.592983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade6eb-5be8-427f-b386-4b33cfdbc5e0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.639073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc446157-690d-4bff-bc16-eb40ed15273b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.643476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.644406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.644689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.644963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/1e523a8d471b45069224472374847aed/roles/d0b7390166c049a7bc750f89524ca3f0` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.655561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, user_id=1e523a8d471b45069224472374847aed, role_id=d0b7390166c049a7bc750f89524ca3f0)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:13.657423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:13.679412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.680291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.680570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.680930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.682270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:13.683976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330933e-13f6-4668-8aa2-36d14db0bcf1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:13.685870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 88/179] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:13 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:13.687171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.687456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.687773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.707014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:13.707361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 92/180] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:13 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/users/1e523a8d471b45069224472374847aed/roles/d0b7390166c049a7bc750f89524ca3f0 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:13.708093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:13.708257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:13.817182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 89/181] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:13.853230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:13.940880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcb86e-5938-423a-9fe6-e4c339abd71c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.994893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:13.995780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:13.996065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f9738-3249-4e0a-9a6f-2c3ebe83c1ae None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:13.996230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:13.996605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:13.999222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=763b9bb9696f4539b6048050128f2089) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:13.999731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.002125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27578701-b890-4541-9b4c-d73bd1afd123 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.009769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 93/182] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:13 2022] GET /identity/v3/role_assignments?user.id=763b9bb9696f4539b6048050128f2089&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:14.011225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f480eb-0454-4398-ad3e-e23a4ed1fb51 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.011522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f480eb-0454-4398-ad3e-e23a4ed1fb51 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.011910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f480eb-0454-4398-ad3e-e23a4ed1fb51 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.013812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 94/183] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:14.019607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.019890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.020178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.051728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:14.052991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:14.090314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.091537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.091824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.092112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.116423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:14.126437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:14.131739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 90/184] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:14.137839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.138182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 95/185] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:14.185913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.284093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa7b00-59f9-4d79-8c07-5061750f214a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.330587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.331077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.331484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.331765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.332549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:14.332853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.334925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2cf5d-20d5-4fea-a999-22f9e6dbb2e4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.344570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34836d4a-7340-49b0-bc38-42df0aa0e2f9 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.345144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 91/186] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:14.349375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a5f7-6894-4e8d-bf02-2330d63e39ca None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.349375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a5f7-6894-4e8d-bf02-2330d63e39ca None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.349785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a5f7-6894-4e8d-bf02-2330d63e39ca None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.351717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 92/187] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:14.352294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a5f7-6894-4e8d-bf02-2330d63e39ca None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.388649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.389716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.390160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.390570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.407349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:14.415618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-c08b680b-5173-4b55-a905-cdd383da9959 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:14.417396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 96/188] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:14.418907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.419458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.419870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.438501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:14.440032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:14.468770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a5f7-6894-4e8d-bf02-2330d63e39ca None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.504695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.505761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.506179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.506636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.509007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 97/189] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:14.510779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.526366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.528231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.530471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 93/190] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:14.538821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.609847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcf0df-2048-47ef-9e00-eced9b9c7839 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.634441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57ff-5ac9-430f-8d63-ab2723b96570 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.642104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.642758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.643040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.643313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.644068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:14.644369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.645851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.654633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 98/191] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:14.657539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.675103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.675902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.676168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.676436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.677607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.679114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.681040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 94/192] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:14.681854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.767517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c003013-ba19-4cc7-9969-9e7376039d26 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.777334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df6fb0-18b4-4434-a378-d42fe0ad4fb5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.801001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.801874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.802352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.802832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.809497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.810382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.810672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.810963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.812166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.813624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.815322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 95/193] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:14.816202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.873472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.874979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.911220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47083d30-02eb-4570-a0ad-eba867eed2ce None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:14.942770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:14.943448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:14.943794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:14.944001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:14.944760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:14.946203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:14.973829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 96/194] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:14 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:14.973829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:14.974113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 99/195] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:14.979681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:15.091508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d72c4-5c0a-4fae-b5d6-603118ac8abf None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:15.091757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380d805-41fa-421b-8e0f-568f9b08a6a5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:15.127021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:15.127232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:15.127680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:15.127916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:15.128029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:15.128195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:15.128284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:15.128463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:15.130070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:15.131648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:15.133816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 100/196] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:15.139743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:15.214863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:15.216342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:15.248919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569763f8-b58d-45c0-9a50-878c26637aed None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:15.293717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:15.294930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:15.296203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:15.296678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:15.297728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=6eac775802f145c6b6054cf26e9786a7) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:15.298236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:15.299933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:15.308569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 101/197] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:15 2022] GET /identity/v3/role_assignments?user.id=6eac775802f145c6b6054cf26e9786a7&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:15.337139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 97/198] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:15.343063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:15.452749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d8975-5487-40ed-addf-a1ad32b17839 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:15.489417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:15.490242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:15.490527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:15.490838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:15.492201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:15.493693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a392c-4188-4b1c-809d-ef75c9a126e1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:15.495518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 102/199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:15 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:15.501605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:15.601773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cd986-0dc1-4d99-8ee0-533f9333500e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:15.634922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:15.635589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:15.635871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:15.636146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:15.636983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=6eac775802f145c6b6054cf26e9786a7) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:15.637294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:15.638783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e153be-fab4-478d-bb55-b411289c5195 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:15.644599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 98/200] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:15 2022] GET /identity/v3/role_assignments?user.id=6eac775802f145c6b6054cf26e9786a7&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=ec45838429e4491ea0215d21e1e01239 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:16.271593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e595a-5fe1-41a0-b948-d1c4f5709eb6 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:16.272167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e595a-5fe1-41a0-b948-d1c4f5709eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:16.272167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e595a-5fe1-41a0-b948-d1c4f5709eb6 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:16.274186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 103/201] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:16.279697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:16.280204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:16.280352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:16.307627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:16.308832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:16.391980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 99/202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:16.428169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e595a-5fe1-41a0-b948-d1c4f5709eb6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:16.572131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e595a-5fe1-41a0-b948-d1c4f5709eb6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:16.614832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:16.615661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:16.616000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:16.616276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:16.635562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:16.642465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:16.643741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 104/203] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:16.649993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:16.759216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0d0c6-abb0-42cd-acb6-8bd28e375092 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:16.797628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:16.798312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:16.798596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:16.798896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:16.799647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:16.799952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:16.801351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:16.809819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 100/204] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:16.815153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:16.939951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424857c-e616-4c23-8806-c8b8b5c490ea None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:16.979818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:16.980702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:16.980980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:16.981254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] PATH_INFO: `/v3/users/1e523a8d471b45069224472374847aed` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:16.982448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=1e523a8d471b45069224472374847aed)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:16.983946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:16.985858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 105/205] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:16 2022] GET /identity/v3/users/1e523a8d471b45069224472374847aed => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:16.991369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:17.091643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839b83-2e80-4e8c-9a2b-6fb96f9ebae0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:17.130071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:17.130801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:17.131090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:17.131363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:17.226135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:17.227585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:17.349944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 101/206] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:17.355481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:17.505578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca343cf7-ccab-4a21-b02a-825b11207bd9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:17.544687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:17.545569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:17.545853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:17.546128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:17.547325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:17.548800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371050dc-7267-49b0-ae48-d06d94d94fad None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:17.550611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 106/207] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:17 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:17.559759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:17.729654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e510c-ec98-4325-bfa1-b09cd5ea34e0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:17.774002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:17.774577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:17.774882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:17.775154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:17.776007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, scope.project.id=768f17a3540d4802bf3dfa3319b69901, user.id=1e523a8d471b45069224472374847aed) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:17.776315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:17.777782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24541bc-e8e4-486d-8d0e-9b334f9e1677 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:17.787318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 102/208] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:17 2022] GET /identity/v3/role_assignments?user.id=1e523a8d471b45069224472374847aed&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:17.972180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9609-061e-42da-a114-53fd073b1240 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:17.972548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9609-061e-42da-a114-53fd073b1240 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:17.972741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9609-061e-42da-a114-53fd073b1240 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:17.974833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 107/209] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:17.980368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d62d-0e4d-4789-bcdf-80a959410125 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:17.980650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d62d-0e4d-4789-bcdf-80a959410125 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:17.980916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74d62d-0e4d-4789-bcdf-80a959410125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.003155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9f74d62d-0e4d-4789-bcdf-80a959410125 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:18.004369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9f74d62d-0e4d-4789-bcdf-80a959410125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:18.080132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 103/210] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:18.105349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9609-061e-42da-a114-53fd073b1240 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.111020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8f62-b97d-460f-b9b1-91e06275579f None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.111306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8f62-b97d-460f-b9b1-91e06275579f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.111594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8f62-b97d-460f-b9b1-91e06275579f None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.113662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 104/211] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:18.123827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.123827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.123827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.140648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:18.141900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:18.217477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9609-061e-42da-a114-53fd073b1240 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.225998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 105/212] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:18.251056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.254560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.255643 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.256114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.256603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.257981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:18.259647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:18.261727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 108/213] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:18.268129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.370179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14365e1e-593b-4d07-a346-3430b7928e11 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.381049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765001ec-4d63-4e49-9aa8-f398a076e34c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.402241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.403076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.403359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.403631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.414302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:18.415358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.416028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.416311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.416587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.417297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:18.420173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d9a02-622c-456f-99bc-4db47bdc450d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:18.421273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-05be77dc-0486-4cda-8f41-883b2bc2fadc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:18.427193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 106/214] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:18.427193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ae93-3834-4878-acb7-b0a3aa7d0384 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.427193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ae93-3834-4878-acb7-b0a3aa7d0384 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.427193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ae93-3834-4878-acb7-b0a3aa7d0384 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.429902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 107/215] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:18.430694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ae93-3834-4878-acb7-b0a3aa7d0384 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.451726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 109/216] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:18 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:18.451726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070111-c0d5-4610-aebf-ef0ed139ef86 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.451726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070111-c0d5-4610-aebf-ef0ed139ef86 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.451726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f070111-c0d5-4610-aebf-ef0ed139ef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.468443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8f070111-c0d5-4610-aebf-ef0ed139ef86 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:18.470840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8f070111-c0d5-4610-aebf-ef0ed139ef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:18.541549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ae93-3834-4878-acb7-b0a3aa7d0384 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.558476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 110/217] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:18.573993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1db8-f7d2-43b6-9f33-1932cbf3d39e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.574289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1db8-f7d2-43b6-9f33-1932cbf3d39e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.574570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca1db8-f7d2-43b6-9f33-1932cbf3d39e None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.576572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 111/218] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:18.583667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.584001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.584284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.586514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.587528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.588147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.588592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.589537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:18.590010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:18.591648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:18.600959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 108/219] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:18.601931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:18.602233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.603287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:18.676321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 112/220] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:18.677098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.709223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ea6f9-3f2c-48b3-b736-9ef55b31b582 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.749035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.749851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.750137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.750409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.762393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:18.770516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:18.773087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 109/221] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:18.773838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.782586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321b7ab-db0c-4c29-b470-733dd595e6f4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.822349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.823286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.823572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.823851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] PATH_INFO: `/v3/users/5bc1c73d80134c6093bef04241f691e5` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.839505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] RBAC: Authorizing `identity:get_user(user_id=5bc1c73d80134c6093bef04241f691e5)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:18.840989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:18.842737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 113/222] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/users/5bc1c73d80134c6093bef04241f691e5 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:18.843499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.894877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05231b4a-be1c-496a-b10f-4bc9d7bb3781 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.930932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.931868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.932248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.932702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:18.943129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:18.950784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:18.952480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 110/223] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:18.952907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8de7b-b1f9-4d06-8e5d-7fe354f501b0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:18.953549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:18.997845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:18.998845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:18.999267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:18.999683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.000997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:19.001490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.003695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.014718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 114/224] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.015840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.063507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47d0c1-2e72-4dae-a8ad-510f4b19937e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.096421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.097319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.097695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.098110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.133566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13cbf3-ff07-4fff-bc2e-eb4031720a1a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.163869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.165497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.173326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.174834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.175277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.175685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.176920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:19.177362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.179428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.190057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 115/225] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.191019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.270795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 111/226] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:19.271893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.304699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aff96c-8e3d-4150-a590-4215dc163f93 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.341396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.342409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.342787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.343182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.344580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.346155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.347951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 116/227] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.353197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.398629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f726-2fae-45a2-8ae2-f716d39f2529 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.434294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.435295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.435665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.436009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.437267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.438825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.445420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 112/228] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.446308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.459832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55105a-8be2-45f0-9ce1-480a3cbca4f8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.498801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.499773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.500384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.500666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.502250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.504139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.506156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 117/229] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.511529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.558383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869050d-090e-49cd-b9b2-aa9c0d8701e6 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.593365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.594246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.594530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.594832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.596935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.598396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.600154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 113/230] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.600154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.641418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309097-d07b-4b15-a664-c397796e53f0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.674969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.676226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.676700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.677181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.678585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.680342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.686959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 118/231] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.687966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.703543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914733c7-dd24-49b3-9303-c377fdc9800e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.739070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.739901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.740007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.740270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.741299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=5bc1c73d80134c6093bef04241f691e5) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:19.741607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.743141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.754692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 114/232] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:19 2022] GET /identity/v3/role_assignments?user.id=5bc1c73d80134c6093bef04241f691e5&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:19.754692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:19.824066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a09af7-d2b9-42ab-83bc-33e9694d20d5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.900248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.901232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.901512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.901827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/6eac775802f145c6b6054cf26e9786a7/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.905556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, user_id=6eac775802f145c6b6054cf26e9786a7, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.907393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc808-2146-4535-bb79-0534abf8344a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:19.928367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 119/233] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:19 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/6eac775802f145c6b6054cf26e9786a7/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:19.950804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd9c32-553f-4e49-95aa-edaa8b94289c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:19.987134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:19.987968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:19.988299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:19.988578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/6eac775802f145c6b6054cf26e9786a7/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:19.990911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, user_id=6eac775802f145c6b6054cf26e9786a7, role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:19.992384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5ba3-c19f-48db-82e1-926fdd319c2f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:20.013807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 115/234] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:19 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/6eac775802f145c6b6054cf26e9786a7/roles/ec45838429e4491ea0215d21e1e01239 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:21.024141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bfa8-5f34-4496-b207-7558fffa3eef None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.025154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bfa8-5f34-4496-b207-7558fffa3eef None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.025657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8bfa8-5f34-4496-b207-7558fffa3eef None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.028019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 120/235] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:21.036677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec6a1-c3c5-4dea-90e5-5f2ea4c21b03 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.037524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec6a1-c3c5-4dea-90e5-5f2ea4c21b03 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.038019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ec6a1-c3c5-4dea-90e5-5f2ea4c21b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.062905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-441ec6a1-c3c5-4dea-90e5-5f2ea4c21b03 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:21.064432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-441ec6a1-c3c5-4dea-90e5-5f2ea4c21b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:21.137822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 116/236] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:21.171764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bfa8-5f34-4496-b207-7558fffa3eef None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.180329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1afe1-b35f-4f1e-b3d2-143f1ea88806 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.180616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1afe1-b35f-4f1e-b3d2-143f1ea88806 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.180895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1afe1-b35f-4f1e-b3d2-143f1ea88806 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.187478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 117/237] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:21.200401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.200687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.200963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.243942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:21.244995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:21.288922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8bfa8-5f34-4496-b207-7558fffa3eef None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.338698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.339886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.341775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.342251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.361434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 118/238] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:21.372102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:21.379470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:21.381273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 121/239] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:21.386887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.387014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.505489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617385d3-05dd-496c-9e13-60b95bef6c85 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.551427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.552023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.552305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.552575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.553384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:21.553688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:21.555110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:21.565680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eb687-da46-4e46-ad92-c7ab18568396 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.567630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 122/240] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:21.572921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.607390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.608220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.608560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.608839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.610019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:21.611512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:21.613213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 119/241] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:21.619944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.681282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9dd71-fc01-4aa2-85b0-15f4e812d4a8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.725795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.727380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.727380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.727380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] PATH_INFO: `/v3/users/cfceb5d4695d4e1f95b0f2093448e94c` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.743202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] RBAC: Authorizing `identity:get_user(user_id=cfceb5d4695d4e1f95b0f2093448e94c)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:21.744933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:21.748377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 123/242] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:21 2022] GET /identity/v3/users/cfceb5d4695d4e1f95b0f2093448e94c => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:21.755509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:21.808495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263be01-9d8d-4ee9-b67e-9d058d3b103e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.888895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fca816-593a-4bf9-bdf9-b3cb067d7b77 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:21.896274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.897203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.897312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.897549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.898265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:21.899775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:21.926379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:21.927636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:21.928368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:21.928935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:21.941628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 120/243] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:21 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:50:22.003722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:22.005573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:22.231475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:22.238670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:22.344312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87472-2e09-437c-a083-cdee2d1a353a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:22.389865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:22.390811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.391098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.391374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.392773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:22.394299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c89562-90c8-4e67-98aa-4f1e5355d452 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:22.396500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 121/245] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:22 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:22.404582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:22.516325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd118f3-2547-45e6-8042-ff823ffdd5d4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:22.555732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:22.556398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.556682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.556955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.557788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=cfceb5d4695d4e1f95b0f2093448e94c) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:22.558098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:22.559578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e904b2-68be-4f48-877a-2b4c7ded4c1f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:22.565639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 125/246] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:22 2022] GET /identity/v3/role_assignments?user.id=cfceb5d4695d4e1f95b0f2093448e94c&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:22.755047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbd2d-c64f-40fa-ab28-afa723aa8546 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.755691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbd2d-c64f-40fa-ab28-afa723aa8546 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.756194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcbd2d-c64f-40fa-ab28-afa723aa8546 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.758491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 122/247] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:22.763839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469d17-8fde-4309-ac98-4bb1c22ca99e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.764126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469d17-8fde-4309-ac98-4bb1c22ca99e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.764404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2469d17-8fde-4309-ac98-4bb1c22ca99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.780846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02f64-4e7a-4a09-9ceb-2727e1c11333 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.781756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02f64-4e7a-4a09-9ceb-2727e1c11333 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.782243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02f64-4e7a-4a09-9ceb-2727e1c11333 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.784229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 123/248] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:22.787049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b2469d17-8fde-4309-ac98-4bb1c22ca99e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:22.787926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b2469d17-8fde-4309-ac98-4bb1c22ca99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:22.789714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.790205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.790691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.812435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:22.813958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:22.862239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 126/249] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:22.863615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0be7-59cb-4ca7-a88e-c87cc0c7ddeb None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.863901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0be7-59cb-4ca7-a88e-c87cc0c7ddeb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.864174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a0be7-59cb-4ca7-a88e-c87cc0c7ddeb None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.866087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 127/250] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:22.875768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:22.876041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:22.876314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:22.903727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:22.905142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:22.960042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 124/251] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:22.960912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:22.976687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 128/252] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:23.000762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.105850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a176ad6-6104-430c-b318-e4687c3e929d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.141708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.142506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.142811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.143082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.154154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:23.161907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:23.163658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 129/253] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:23.164602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.212758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1fac4-2cd3-4af4-a316-426de80c09d4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.272024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed402-aee5-4288-bcaa-6ebabacd80c7 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.303425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.304249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.304530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.304798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.306524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.307514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.307790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.308062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.318761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:23.326585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:23.328310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 130/254] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:23.328907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.335563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:23.342979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:23.352077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 125/255] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:23.353148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.461239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb706-37a1-4976-9d70-6bdc8994412d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.506080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.507153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.507655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.508133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.509075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:23.509571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:23.511202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:23.519980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 126/256] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:23.521102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.533128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b7c99-a8b6-4e43-9da0-d35d6a0d0c99 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.620228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e145d-3572-4002-98b5-1cf110d4115a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.620691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.621375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.621659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.621935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.622731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:23.623018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:23.624566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:23.646156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 131/257] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:23.647393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.655052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.655933 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.656742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.657184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.658079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:23.658525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:23.660119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:23.670734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 127/258] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:23.672592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.791455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b892bc5-8a7c-4f34-95a2-0f87c769fd31 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.841187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4795e0c-e70f-4f16-a9c7-e32537eaca7e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:23.844989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.845934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.846223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.846503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.848806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:23.850368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:23.852070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 132/259] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:23.853899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:23.876313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:23.877212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:23.877493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:23.877763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] PATH_INFO: `/v3/users/5bc1c73d80134c6093bef04241f691e5` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:23.879119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] RBAC: Authorizing `identity:get_user(user_id=5bc1c73d80134c6093bef04241f691e5)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:23.880615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:23.882472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 128/260] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/users/5bc1c73d80134c6093bef04241f691e5 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:23.889297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.033872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd611e-bbe1-4665-ac73-8ae514590ceb None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.054681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed7e4-6c7a-452e-b5f4-bf117453a542 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.067916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.068572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.068916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.069193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.115676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.117061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.117531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.117994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] PATH_INFO: `/v3/users/6eac775802f145c6b6054cf26e9786a7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.123158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] RBAC: Authorizing `identity:get_user(user_id=6eac775802f145c6b6054cf26e9786a7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.124707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.127796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 133/261] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/users/6eac775802f145c6b6054cf26e9786a7 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:24.128658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.134974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.136440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.232276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa36b55-7ad0-4d10-9cad-1d67a854969c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.268321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.269196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.269473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.270146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.271364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.272897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.274592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 134/262] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:24 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:24.275374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.322505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 129/263] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:24.323299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.444545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683dbf1-d9bb-4416-98cf-4dc73a4dc56b None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.457116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a51605-252d-4afd-8399-4a723a32195d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.477144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.478046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.478323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.478596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/5bc1c73d80134c6093bef04241f691e5/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.480552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, user_id=5bc1c73d80134c6093bef04241f691e5, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.481990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.511319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 130/264] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:24 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/5bc1c73d80134c6093bef04241f691e5/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:24.513080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.553896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.554572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.554874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.555146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.714288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.715815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.746873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7646-4ea5-4637-96b9-d820e63c9751 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:24.820920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:24.822238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:24.822749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:24.823236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:24.825319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:24.827043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:24.829702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 131/265] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:24 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:24.836205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:24.905911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 135/266] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:24.911572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.012324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae7555-584a-42fc-9e2b-e1ba0f33f4a9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:25.076021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73386dd-37b2-4324-893a-9f81c77aa9a4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:25.080119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:25.080836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.081127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.081405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.082269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=6eac775802f145c6b6054cf26e9786a7) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:25.082587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:25.084273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:25.095483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 132/267] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:24 2022] GET /identity/v3/role_assignments?user.id=6eac775802f145c6b6054cf26e9786a7&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=ec45838429e4491ea0215d21e1e01239 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:25.115699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:25.116981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.117466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.117931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.119413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:25.121091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53896ae-1c3e-4bed-ba87-5e919ed1acb6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:25.123399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 136/268] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:24 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:25.130670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.280714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f04f61-ec29-4512-af7a-2e55e02544fc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:25.324680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:25.325478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.325756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.325972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.326799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=6eac775802f145c6b6054cf26e9786a7) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:25.327113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:25.328575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7450dba-7081-4152-acd4-0116254036bb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:25.339616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 133/269] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:25 2022] GET /identity/v3/role_assignments?user.id=6eac775802f145c6b6054cf26e9786a7&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:25.462458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b701-b6da-4cb8-bed1-3881b360770c None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.463529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b701-b6da-4cb8-bed1-3881b360770c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.464008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56b701-b6da-4cb8-bed1-3881b360770c None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.468350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a05e8-a553-47e1-a979-a5b88d23e87d None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.468622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a05e8-a553-47e1-a979-a5b88d23e87d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.468896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a05e8-a553-47e1-a979-a5b88d23e87d None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.473062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 134/270] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:25.474737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559601fb-3f62-44a9-87ec-698503981742 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.475179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559601fb-3f62-44a9-87ec-698503981742 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.475381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559601fb-3f62-44a9-87ec-698503981742 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.475784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 137/271] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:25.477165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 135/272] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:25.480950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.481133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576231b-7b0d-415f-a7d8-78f667448ada None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.481215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.481285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576231b-7b0d-415f-a7d8-78f667448ada None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.481504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.481608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576231b-7b0d-415f-a7d8-78f667448ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.507920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5576231b-7b0d-415f-a7d8-78f667448ada None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:25.509175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5576231b-7b0d-415f-a7d8-78f667448ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:25.612986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 138/273] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:25.614055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.614350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.614628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.627761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:25.628951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:25.632350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:25.633560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:25.711599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 139/274] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:25.712488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.714748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 136/275] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:25.738077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.820246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66851e5f-d7f2-4286-9abc-108ec56c846b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:25.851395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f14de-3721-4038-ba58-117d6e5d2563 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:25.853147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:25.853979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.854264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.854541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.855772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:25.857256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:25.858965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 140/276] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:25.859738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.890978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:25.891806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:25.892089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:25.892359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:25.902400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:25.909755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:25.910993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 137/277] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:25.911756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:25.970830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb305-8a6f-4adb-8207-4ef10d43913b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.004567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.005377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.005655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.005818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9ead-0c42-404d-b36b-262b6b8e2a8d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.005915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.017519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:26.024537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:26.025775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 141/278] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:26.027505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.042014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.042723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.043010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.043283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.043995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.045446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.078677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 138/279] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:25 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:26.078677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.157955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be70aa1-c39c-4796-a0ce-24282d377ba0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.182366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3d919-0ea0-4676-9c47-bbb90f70f699 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.193549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.194403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.194728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.195014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.195794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:26.196102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.197534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.207026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 142/280] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:26.215784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.222697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.223455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.223744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.224024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.224879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:26.225267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.226870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.236077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 139/281] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:26.241704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.341330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1dbb2-73f9-4674-bc0c-b4dbc6632ed0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.360310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d066c7-4a9d-40b0-bc65-14be0fce1f9f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.392444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.393426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.393776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.394055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] PATH_INFO: `/v3/users/cfceb5d4695d4e1f95b0f2093448e94c` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.396742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] RBAC: Authorizing `identity:get_user(user_id=cfceb5d4695d4e1f95b0f2093448e94c)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.398265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.398890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.399786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.400069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.400264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 143/282] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/users/cfceb5d4695d4e1f95b0f2093448e94c => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:26.400432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] PATH_INFO: `/v3/users/de18c5dff8344a15b900cf431b02e445` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.405625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.416263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] RBAC: Authorizing `identity:get_user(user_id=de18c5dff8344a15b900cf431b02e445)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.417985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.419765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 140/283] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/users/de18c5dff8344a15b900cf431b02e445 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:26.428703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.544149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fd51-4f54-4f4d-a307-d791eee79533 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.557291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8ce50-dd54-48f1-b0df-844910602773 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.610012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.611675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.611968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.612292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.615337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.615472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.616323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.616749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.616902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.617291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.618251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, user.id=de18c5dff8344a15b900cf431b02e445, scope.system=all) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:26.618735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.618990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 144/284] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:26.620556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25580418-eaad-4bc8-bcfb-eb361ed5be68 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.626600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 141/285] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Apr 1 09:50:26 2022] GET /identity/v3/role_assignments?user.id=de18c5dff8344a15b900cf431b02e445&scope.system=all&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:26.630852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:26.740821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7ec1b-bea0-43ab-9cbf-66c7a27c64d1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:26.775503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:26.776419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:26.776703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:26.776976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/cfceb5d4695d4e1f95b0f2093448e94c/roles/d0b7390166c049a7bc750f89524ca3f0` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:26.779089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, user_id=cfceb5d4695d4e1f95b0f2093448e94c, role_id=d0b7390166c049a7bc750f89524ca3f0)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:26.780603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268beeb-4c3e-4839-8e8e-ffa6ab7adfb7 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:26.803112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 145/286] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:50:26 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/users/cfceb5d4695d4e1f95b0f2093448e94c/roles/d0b7390166c049a7bc750f89524ca3f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:27.441874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82b31-b94b-4773-81bf-9372eea82abb None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:27.442398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82b31-b94b-4773-81bf-9372eea82abb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:27.442398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82b31-b94b-4773-81bf-9372eea82abb None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:27.444545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 142/287] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:27.450023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:27.450313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:27.450585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:27.478856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:27.480056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:27.584094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 146/288] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:27.615654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82b31-b94b-4773-81bf-9372eea82abb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:27.752275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82b31-b94b-4773-81bf-9372eea82abb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:27.801634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:27.802897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:27.803429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:27.803923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:27.819343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:27.826807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:27.828641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 143/289] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:27.834150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:27.964697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64ec7-9aee-43ad-95ef-70ae57a5ae2c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:28.012766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:28.013362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:28.013640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:28.013915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:28.014679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:28.014987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:28.016361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:28.024820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 147/290] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:28.030494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:28.148761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e53d2f-744d-4339-8a5f-1522d3f71dfc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:28.193939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:28.194947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:28.195231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:28.195506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] PATH_INFO: `/v3/users/5bc1c73d80134c6093bef04241f691e5` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:28.197816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] RBAC: Authorizing `identity:get_user(user_id=5bc1c73d80134c6093bef04241f691e5)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:28.199356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:28.201289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 144/291] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:28 2022] GET /identity/v3/users/5bc1c73d80134c6093bef04241f691e5 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:28.206999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:28.332989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906301b-0c41-49f9-9a0b-8fd0b1ede4a3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:28.375404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:28.376088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:28.376369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:28.376646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:28.458490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:28.460042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:28.561333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 148/292] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:28.566986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:28.676049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff64f6-3e5e-4ffd-a1a6-064504e54681 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:28.718204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:28.719503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:28.719980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:28.720446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:28.723989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:28.726620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a4f4b-d6a3-4cf6-8a44-5db58031ce68 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:28.728637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 145/293] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:28 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:28.734976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:28.892461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253154c6-a0fb-4e9c-b3d1-2cd50c82379b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:28.937741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:28.938337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:28.938623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:28.938925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:28.939758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=5bc1c73d80134c6093bef04241f691e5) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:28.940070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:28.941515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455b78a-d700-42ce-bfdc-12fc53516cf0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:28.951798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 149/294] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:28 2022] GET /identity/v3/role_assignments?user.id=5bc1c73d80134c6093bef04241f691e5&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:29.074418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937b22-89fc-4283-ab7b-2e8b1f6522b1 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.074785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937b22-89fc-4283-ab7b-2e8b1f6522b1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.074992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937b22-89fc-4283-ab7b-2e8b1f6522b1 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.077174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 146/295] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:29.082984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f68e-a1c3-4fde-b1dc-1aad08e6e3dc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.083294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f68e-a1c3-4fde-b1dc-1aad08e6e3dc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.083559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219f68e-a1c3-4fde-b1dc-1aad08e6e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.107764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b219f68e-a1c3-4fde-b1dc-1aad08e6e3dc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:29.108989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b219f68e-a1c3-4fde-b1dc-1aad08e6e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:29.199835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 150/296] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:29.231253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937b22-89fc-4283-ab7b-2e8b1f6522b1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.270428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ebe-f8fb-470f-862c-e0ed81068d0e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.270761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ebe-f8fb-470f-862c-e0ed81068d0e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.271015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82277ebe-f8fb-470f-862c-e0ed81068d0e None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.273184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 151/297] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:29.279021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8640-b598-4805-9782-1993c28ef8c9 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.279428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8640-b598-4805-9782-1993c28ef8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.279806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad8640-b598-4805-9782-1993c28ef8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.298922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f8ad8640-b598-4805-9782-1993c28ef8c9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:29.300149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f8ad8640-b598-4805-9782-1993c28ef8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:29.353879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937b22-89fc-4283-ab7b-2e8b1f6522b1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.374160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 152/298] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:29.375571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8a26-7e9b-4842-bce0-832b27867a8a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.375863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8a26-7e9b-4842-bce0-832b27867a8a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.376144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8a26-7e9b-4842-bce0-832b27867a8a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.378035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 153/299] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:29.384042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.384335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.384614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.396971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.398230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.398513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.398816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.399993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:29.401462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:29.401972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:29.403284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 147/300] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:29.403391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:29.403986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.476695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 154/301] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:29.477451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.511761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df179e-03b3-4109-9cc6-f6c972e1ec7b None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.544958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.545762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.546045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.546319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.556031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:29.563898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:29.566687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 148/302] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:29.566687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.576916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48683b0-3f5e-485f-afb1-14f0c7f9ee39 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.609607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.610304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.610594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.610921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] PATH_INFO: `/v3/groups` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.611632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:29.613114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:29.629548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 155/303] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Apr 1 09:50:29 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:29.630795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.671898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036b27-fad5-451d-9c04-bba9cccd92fa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.708075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.708297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.708530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.708654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.720238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:29.727635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:29.729224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 149/304] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:29.739899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.741368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47582a-97f7-4384-a463-8787d906f5a1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.777465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.778515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.779016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.779534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.780577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:29.780953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:29.782835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:29.793430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 156/305] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:29.799056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.876189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e915337-9c7d-4cfe-98be-d930c98d32e0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.915261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.916297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.916759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8add26-5f83-4e8b-a668-03e457baa950 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:29.916975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.917458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.918421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:29.918983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:29.920584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:29.929619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 150/306] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:29.935464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:29.955310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:29.956535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:29.956824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:29.957100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] PATH_INFO: `/v3/users/de18c5dff8344a15b900cf431b02e445` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:29.958333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] RBAC: Authorizing `identity:get_user(user_id=de18c5dff8344a15b900cf431b02e445)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:29.959863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:29.962258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 157/307] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/users/de18c5dff8344a15b900cf431b02e445 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:29.968327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.043135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850102f3-e670-4927-baba-f2af39d10073 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.076121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.076631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e3a0b-75de-4ca7-9717-cb728cec3340 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.077448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.077884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.078292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] PATH_INFO: `/v3/users/15ebef79eccf440dbfcf067d56c925ad` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.092430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] RBAC: Authorizing `identity:get_user(user_id=15ebef79eccf440dbfcf067d56c925ad)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.093984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ca51c-ec25-4424-8afd-3b3a056c041a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:30.100801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 151/308] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:29 2022] GET /identity/v3/users/15ebef79eccf440dbfcf067d56c925ad => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:30.101965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4417-d194-4796-b600-f1652030f1f3 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.102255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4417-d194-4796-b600-f1652030f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.102535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4417-d194-4796-b600-f1652030f1f3 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.108543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 152/309] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:30.108543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4417-d194-4796-b600-f1652030f1f3 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.112524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.113402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.113685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.113960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] PATH_INFO: `/v3/system/users/de18c5dff8344a15b900cf431b02e445/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.115548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de18c5dff8344a15b900cf431b02e445, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.116944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5137134-8fe0-4cbf-ba34-4679de146766 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:30.127289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 158/310] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Apr 1 09:50:29 2022] PUT /identity/v3/system/users/de18c5dff8344a15b900cf431b02e445/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:30.136351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.136672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.136918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.157610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:30.159029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:30.221687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4417-d194-4796-b600-f1652030f1f3 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.236647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 159/311] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:30.267678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.273999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.275113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.275677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.276151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.277839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, user.id=15ebef79eccf440dbfcf067d56c925ad, scope.system=all) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:30.278438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.281449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:30.289037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 153/312] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Apr 1 09:50:30 2022] GET /identity/v3/role_assignments?user.id=15ebef79eccf440dbfcf067d56c925ad&scope.system=all&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:30.380251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b4f92-eb97-446b-a528-93d17e54224b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.416182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.416997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.417276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.417545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.428841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:30.436127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:30.437639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 160/313] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:30.443873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.550775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ebb27-0341-4849-8d22-81ce1a52da86 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.584553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.585598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.586101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.586617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.587854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:30.588424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.590347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:30.600427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 154/314] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:30.605830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.708071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9b21a-d4bb-4b37-9e5a-2f5fddf60a31 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.740570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.741453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.742010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.742010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] PATH_INFO: `/v3/users/cfceb5d4695d4e1f95b0f2093448e94c` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.743328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] RBAC: Authorizing `identity:get_user(user_id=cfceb5d4695d4e1f95b0f2093448e94c)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.744837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:30.750831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 161/315] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:30 2022] GET /identity/v3/users/cfceb5d4695d4e1f95b0f2093448e94c => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:30.752605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:30.848156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f9d10-ffc5-413a-bd13-e2b49c0538e3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:30.882825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:30.883837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:30.884317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:30.884819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:30.952267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:30.954131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:31.051655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 155/316] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:31.057111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:31.153362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29cb6f-a87c-4cac-aab7-1b81902e1f76 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:31.185719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:31.186585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:31.186894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:31.187173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:31.188352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:31.189861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc05a7-0f73-48d8-8821-f01f7b1b80bc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:31.191804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 162/317] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:31 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:31.197606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:31.299695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de69e8-6912-442b-a7d8-b925abf7522f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:31.334767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:31.335657 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:31.336136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:31.336555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:31.337569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82, user.id=cfceb5d4695d4e1f95b0f2093448e94c) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:31.338136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:31.339807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b3985-16b0-4bd0-9cae-4b1a1b68cb88 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:31.346463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 156/318] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:31 2022] GET /identity/v3/role_assignments?user.id=cfceb5d4695d4e1f95b0f2093448e94c&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:32.053985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed57f-c786-411d-b430-4d64e81de6f3 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.054558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed57f-c786-411d-b430-4d64e81de6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.054558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ed57f-c786-411d-b430-4d64e81de6f3 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.056321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 163/319] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:32.061840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135cce-3762-4d5f-8356-a49071847975 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.062269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135cce-3762-4d5f-8356-a49071847975 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.062365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135cce-3762-4d5f-8356-a49071847975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.079474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-13135cce-3762-4d5f-8356-a49071847975 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:32.080645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-13135cce-3762-4d5f-8356-a49071847975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:32.152358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 157/320] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:32.175472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed57f-c786-411d-b430-4d64e81de6f3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.280896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ed57f-c786-411d-b430-4d64e81de6f3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:32.313764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:32.314503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.314814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.315095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.316296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:32.317790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c86654-a462-4467-88c7-05c9e245a412 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:32.319793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 164/321] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:32.325647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135cce-3762-4d5f-8356-a49071847975 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.421879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135cce-3762-4d5f-8356-a49071847975 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:32.455993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:32.456668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.456932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.457230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] PATH_INFO: `/v3/groups` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.457914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:32.459431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e98f5-78d5-4e03-a1df-f7fd25bcfe6b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:32.461438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531117-268a-4d6a-a591-a7fd1c348601 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.461732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531117-268a-4d6a-a591-a7fd1c348601 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.462011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12531117-268a-4d6a-a591-a7fd1c348601 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.463954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 165/322] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:32.472964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e888-0780-49a8-939f-7a713baa2605 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.473505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e888-0780-49a8-939f-7a713baa2605 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.473859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5e888-0780-49a8-939f-7a713baa2605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.486687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 158/323] 10.222.0.46 () {60 vars in 1134 bytes} [Fri Apr 1 09:50:32 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:32.494329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9af5e888-0780-49a8-939f-7a713baa2605 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:32.495607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9af5e888-0780-49a8-939f-7a713baa2605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:32.566139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 166/324] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:32.568495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2438e-1541-4ee6-b791-1f498721c076 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.568786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2438e-1541-4ee6-b791-1f498721c076 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.569060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2438e-1541-4ee6-b791-1f498721c076 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.570869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 159/325] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:32.576903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.577196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.577474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.590368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2438e-1541-4ee6-b791-1f498721c076 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.596775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:32.598012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:32.667968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 167/326] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:32.690863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.702302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2438e-1541-4ee6-b791-1f498721c076 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:32.740526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:32.741598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.741598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.741889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.755011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:32.761788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:32.763387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 160/327] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:32.769035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.805592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9469-6ad0-4e58-b614-8790ff470d10 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:32.849486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:32.850305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.850588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.850964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.864319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:32.871707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:32.873125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 168/328] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:32.879406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.897360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776f74a-6b3f-43cf-abbf-2a5899552814 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:32.943326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:32.944076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:32.944362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:32.945370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:32.945370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:32.945698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:32.947144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:32.960698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 161/329] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:32.966030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:32.999563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ae315-2303-43d0-a7ee-289d0ac17ab6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:33.037222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:33.037906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:33.038190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:33.038467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:33.039248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:33.039633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:33.040928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:33.051452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 169/330] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:33.058543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:33.090532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bff40-8e0b-4fbf-940f-1b2e11c60ba3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:33.124552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:33.125674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:33.126126 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:33.126551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] PATH_INFO: `/v3/users/de18c5dff8344a15b900cf431b02e445` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:33.128958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] RBAC: Authorizing `identity:get_user(user_id=de18c5dff8344a15b900cf431b02e445)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:33.130581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:33.132781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 162/331] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:32 2022] GET /identity/v3/users/de18c5dff8344a15b900cf431b02e445 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:33.138593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:33.159799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92d19e-93a3-4617-ae4a-beb1275831c7 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:33.194061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:33.195207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:33.195617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:33.196000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] PATH_INFO: `/v3/users/15ebef79eccf440dbfcf067d56c925ad` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:33.197338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] RBAC: Authorizing `identity:get_user(user_id=15ebef79eccf440dbfcf067d56c925ad)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:33.198964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:33.201124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 170/332] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:33 2022] GET /identity/v3/users/15ebef79eccf440dbfcf067d56c925ad => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:33.210723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:33.248254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1530dee-dc0d-4c16-bc64-02d14d4d0c74 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:33.282015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:33.283810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:33.284278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:33.284778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:33.285833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] RBAC: Adding query filter params (role.id=093bf7d1ef5340058d9e975518b94a39, user.id=de18c5dff8344a15b900cf431b02e445, scope.system=all) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:33.286340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:33.288140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45fc15-578b-4906-aba6-747b2076eeaf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:33.300388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 163/333] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Apr 1 09:50:33 2022] GET /identity/v3/role_assignments?user.id=de18c5dff8344a15b900cf431b02e445&scope.system=all&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:33.325091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da602b-4ae7-46c5-921f-90ed4b24f55a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:33.366109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:33.367046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:33.367424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:33.367708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] PATH_INFO: `/v3/system/users/15ebef79eccf440dbfcf067d56c925ad/roles/d0b7390166c049a7bc750f89524ca3f0` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:33.369313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15ebef79eccf440dbfcf067d56c925ad, role_id=d0b7390166c049a7bc750f89524ca3f0)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:33.370795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400bfd1-67fa-44bd-b37e-65c382ea3404 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:33.381438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 171/334] 10.222.0.46 () {58 vars in 1334 bytes} [Fri Apr 1 09:50:33 2022] PUT /identity/v3/system/users/15ebef79eccf440dbfcf067d56c925ad/roles/d0b7390166c049a7bc750f89524ca3f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:50:35.468947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3739-0f0c-4c19-b461-4c05cc05a9b7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:35.469539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3739-0f0c-4c19-b461-4c05cc05a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:35.469539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f3739-0f0c-4c19-b461-4c05cc05a9b7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:35.471661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 164/335] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:35.479478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:35.479972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:35.480053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:35.508440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:35.509632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:35.600397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 172/336] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 01 09:50:35.648980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3739-0f0c-4c19-b461-4c05cc05a9b7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:35.776454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f3739-0f0c-4c19-b461-4c05cc05a9b7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:35.814943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:35.815752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:35.816035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:35.816309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:35.827757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:35.835365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f3a0f75d-8225-40f6-a76b-5085b1177cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:35.836932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 165/337] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:35.844158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:35.951994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5ffd-3f7b-43ee-89cc-659ec14e8f06 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:35.954085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5ffd-3f7b-43ee-89cc-659ec14e8f06 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:35.954576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5ffd-3f7b-43ee-89cc-659ec14e8f06 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:35.956908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 166/338] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:35.962533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:35.963127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:35.963605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:35.973915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af42486-7ed6-4efb-a74a-906f0e3256ab None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.003776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:36.005383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:36.041144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.041761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.042051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.042331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.043434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:36.043434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:36.050671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:36.065430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 173/339] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:36.071789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.143562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 167/340] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:36.188766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.249863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd3b1-0245-4991-a179-254f67b6c56c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.294023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.295063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.298293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.298847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.376054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97d8ca-9afc-4e5b-b8b9-00a6ea2b6928 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.418431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.419413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.419694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.420013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.435431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:36.443678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3b05c632-d1b1-4df4-a284-e6d59ebad41c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:36.445307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 168/341] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:36.446776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee6c8-c239-4a23-b8f1-d0944288827a None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.447112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee6c8-c239-4a23-b8f1-d0944288827a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.447386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaee6c8-c239-4a23-b8f1-d0944288827a None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.449601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 169/342] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:36.450798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee6c8-c239-4a23-b8f1-d0944288827a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.481089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:36.482627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:36.565225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaee6c8-c239-4a23-b8f1-d0944288827a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.601950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.602621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.602925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.603195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.604169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:36.604490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:36.605937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282aef9-608d-4f53-881c-6eb508543e02 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:36.615476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 170/343] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:36.616938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.617231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.617506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.636539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:36.637717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:36.715823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 171/344] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:36.717015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.731950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 174/345] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:36.737737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.821418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e7961-ef15-419c-9a8d-5f31e92f085a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.861288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.862588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.863052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.863472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.889272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff84db0-7cea-474d-ba97-ca7b2a82dbae None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:36.927464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:36.929229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:36.929668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:36.930269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:36.932287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:36.934623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:36.936525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 175/346] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:36.937591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:36.942416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:36.947685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49840ae-09d6-4bf7-afb9-0bae854c83bd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.046662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f037d15-d734-4127-85d2-5e611ab403df None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.046981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 172/347] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:37.048440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9beb-d40c-4b6c-a402-5a4b8889bdfd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.048875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9beb-d40c-4b6c-a402-5a4b8889bdfd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.049310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca9beb-d40c-4b6c-a402-5a4b8889bdfd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.051178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 173/348] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:37.052023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca9beb-d40c-4b6c-a402-5a4b8889bdfd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.090570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.091381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.092438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.092438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.106243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:37.113351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-30981a1b-ed2a-49f6-b6b5-1df3ef837dec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:37.114878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 176/349] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:37.116329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66a50-e771-471a-b9cd-35c41ab251e3 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.116615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66a50-e771-471a-b9cd-35c41ab251e3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.116890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c66a50-e771-471a-b9cd-35c41ab251e3 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.119101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 177/350] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:37.120139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.120427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.120707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.138852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:37.140049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:37.184254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca9beb-d40c-4b6c-a402-5a4b8889bdfd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.224569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.225509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.225794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.226072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.227010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 178/351] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:37.227864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.240966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.243472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.246227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 174/352] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:37.247284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.347635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dae21-9c33-4668-a180-a8cc16fd3878 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.366963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dde59-df4e-49cf-9114-cb6c098c54fa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.390143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.391101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.391467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.391655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.393117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.394843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca330d-9037-4d3a-b998-cd90a53aa93f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.397266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 179/353] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:37.403124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.403476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.403764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.411137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.412052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.412367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.412642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.415436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:37.415969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.418029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.422900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:37.424105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:37.429577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 175/354] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:37.430272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.504705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 180/355] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:37.505585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.579456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362820-cde6-4734-8062-22e09cea4fb7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.626379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ef3c4-6d0a-492b-8280-5569f4195090 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.628252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.628934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.629220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.629498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.630341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=768f17a3540d4802bf3dfa3319b69901) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:37.630681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.632172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.639523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 176/356] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:37.640641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.663373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.664266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.664708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.665167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.677668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:37.685384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:37.687360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 181/357] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:37.688315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.756857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be794-ebd6-431f-9fe0-74809d1435b8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.792557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a9e-d982-4d75-af84-d80c8ade170e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.796795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.798328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.798328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.798328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.799460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.803098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.803098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 177/358] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:37.803534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:37.836521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.837418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.837528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.837751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.931688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df82ced-36dc-4898-981a-3f9fb8428289 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:37.939230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:37.940929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96a398-f0d4-497d-9003-7cfeaf62896a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:37.970074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:37.971462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:37.972274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:37.972760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:37.984978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:37.992605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 01 09:50:37.994465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 178/359] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:37.995625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.069051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 182/360] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:38.070462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a7f3-15e6-4aeb-a5b8-678824ae4acf None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.070773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a7f3-15e6-4aeb-a5b8-678824ae4acf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.071048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a7f3-15e6-4aeb-a5b8-678824ae4acf None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.072985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 183/361] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:38.073708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8a7f3-15e6-4aeb-a5b8-678824ae4acf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.113894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f89360-0b2d-44b8-b56e-354dd1b260dd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.155303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.156335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.156617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.156891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.157650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:38.157954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.159358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.169506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 179/362] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.170354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.194975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8a7f3-15e6-4aeb-a5b8-678824ae4acf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.243038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.243703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.243985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.244264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.245090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=768f17a3540d4802bf3dfa3319b69901) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:38.245404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.246892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.252846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 184/363] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=ec45838429e4491ea0215d21e1e01239 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.253194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.299434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d216-9f4b-46f5-aff6-eb4b781f6316 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.343099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.344317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.344757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.345170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.346351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:38.346821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.349300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7c580-d090-4b7b-9235-5a19321753d6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.361365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 180/364] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.363010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.363595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.364007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.372340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1660c-b189-4496-ae23-4d21f0fbf4af None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.384702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:38.386566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:38.415358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.416291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.416651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.416890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.418828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.420322 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.422217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 185/365] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.423046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.474561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 181/366] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:38.475427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.537316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6762c-1831-4758-9b1d-51d8ca122503 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.576760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.577763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.578047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.578630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.605293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ce62-d832-4f3b-aebf-e48ea386014a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.649700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.650678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.650962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.651239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] PATH_INFO: `/v3/users/15ebef79eccf440dbfcf067d56c925ad` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.652508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] RBAC: Authorizing `identity:get_user(user_id=15ebef79eccf440dbfcf067d56c925ad)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.653960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.655816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 182/367] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/users/15ebef79eccf440dbfcf067d56c925ad => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.657829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.667461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.669020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.775557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 186/368] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:38.780681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.782244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1e59-a6a7-4d62-ab19-21695394657c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.822862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.823745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.824073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.824350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.825546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.827049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.829199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 183/369] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.830122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.893645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4b380-0516-4f27-8f0b-f7be2ec4fc26 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.931017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae90452-53bf-45b3-8ad8-68550523fb2c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:38.938183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.939037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.939324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.939596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.953043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:38.963294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:38.965123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 187/370] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:38.965945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:38.968709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:38.969383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:38.969669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:38.969947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:38.970990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] RBAC: Adding query filter params (role.id=d0b7390166c049a7bc750f89524ca3f0, user.id=15ebef79eccf440dbfcf067d56c925ad, scope.system=all) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:38.971306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:38.972769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:38.988655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 184/371] 10.222.0.46 () {56 vars in 1308 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/role_assignments?user.id=15ebef79eccf440dbfcf067d56c925ad&scope.system=all&role.id=d0b7390166c049a7bc750f89524ca3f0 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:38.989548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.110225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e51d3-6e58-453c-947f-9fa321406a0c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.152582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.153483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.153801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.154079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.156313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.157979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.160102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 188/372] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:39.165745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.187809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3349dab-e114-4ef4-bcab-e6632a1729b3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.231441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.232551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.233033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.233534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.234590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:39.235143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.236868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.247384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 185/373] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:38 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:39.248598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.285170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac27f39-70ab-4a83-a642-7c66825dc21b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.344665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.345793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.346255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.346724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.347541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:39.347940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.349406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.366204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 189/374] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:39.369789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90528404-6f95-4f30-8b1c-91afb2d0c6e1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.371918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.407800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.409172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.409667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.410188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.411789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.413634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.415630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 186/375] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:39 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:39.421445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.548489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7281da-8f8c-4e42-b2bb-4e840b20aa40 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.580379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f1b61-ce1d-4374-9907-834160c73698 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.589794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.590884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.591173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.591454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.592310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:39.592628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.594752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.602735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 187/376] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:39 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=ec45838429e4491ea0215d21e1e01239 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:39.625562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.626227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.626512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.626871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.698330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.699845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.816113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:39.822445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:39.958007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d620930-dd8b-40b6-81c0-b4ceb41ef824 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:39.991110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81815443-b843-469a-be61-71bec796e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:39.991989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815443-b843-469a-be61-71bec796e026 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:39.992555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815443-b843-469a-be61-71bec796e026 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:39.992840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815443-b843-469a-be61-71bec796e026 None admin] PATH_INFO: `/v3/projects/049efb42322340008044df453447aaa7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:39.994038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815443-b843-469a-be61-71bec796e026 None admin] RBAC: Authorizing `identity:get_project(project_id=049efb42322340008044df453447aaa7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:39.995525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815443-b843-469a-be61-71bec796e026 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:39.997548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 188/378] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:39 2022] GET /identity/v3/projects/049efb42322340008044df453447aaa7 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:40.002922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:40.132873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3993456-1993-4711-b31c-a6c4fd03e478 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:40.178466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:40.179401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:40.179695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:40.179967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] PATH_INFO: `/v3/groups/074ad9820f864f5d90ae2e46bc61850a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:40.191543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] RBAC: Authorizing `identity:get_group(group_id=074ad9820f864f5d90ae2e46bc61850a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:40.193304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189df9b-b97d-4773-97bd-110061078c23 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:40.195535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 191/379] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:40 2022] GET /identity/v3/groups/074ad9820f864f5d90ae2e46bc61850a => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:40.201661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81815443-b843-469a-be61-71bec796e026 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:40.354332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81815443-b843-469a-be61-71bec796e026 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:40.397495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:40.398161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:40.398443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:40.398738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:40.399565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] RBAC: Adding query filter params (group.id=074ad9820f864f5d90ae2e46bc61850a, role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=049efb42322340008044df453447aaa7) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:40.399873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:40.401296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a685f-9d5b-48e7-a511-e2e9bd69b274 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:40.410938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 189/380] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:40 2022] GET /identity/v3/role_assignments?group.id=074ad9820f864f5d90ae2e46bc61850a&scope.project.id=049efb42322340008044df453447aaa7&role.id=f9d36af787804f248e9bea8324501c2a => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:40.617156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac950f-8f53-4576-b3d1-364116be61ea None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:40.617668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac950f-8f53-4576-b3d1-364116be61ea None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:40.617668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac950f-8f53-4576-b3d1-364116be61ea None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:40.619894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 192/381] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:40.625549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:40.625840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:40.626104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:40.647783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:40.648980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:40.741645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 190/382] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:40.766332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac950f-8f53-4576-b3d1-364116be61ea None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:40.903204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac950f-8f53-4576-b3d1-364116be61ea None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:40.937808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:40.939067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:40.939563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:40.940028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:40.955351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:40.963005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:40.964914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 193/383] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:40.970384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.072187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2823b0-33e9-4992-9868-fe7aab35fabc None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.110054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.111199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.111695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.112212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.113183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:41.113695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:41.115329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ae392-1df5-48fe-bcc6-8ce536e7a20a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:41.124736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 191/384] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:41.130775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.167425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6f46-3bd0-42a9-ad80-1b189cd945b9 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.168142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6f46-3bd0-42a9-ad80-1b189cd945b9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.168624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b6f46-3bd0-42a9-ad80-1b189cd945b9 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.170676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 192/385] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:41.175859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.176416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.176884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.203275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:41.204923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:41.316078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 193/386] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:41.326852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141017c-fdb3-419c-882d-d5109d6c3ef5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.359689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.360564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.360847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.361119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.362304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:41.363802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:41.365862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 194/387] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:41 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:41.371223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.405275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.542558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca4aa-813d-4f31-b79b-de4a58546bdd None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.551889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cb4ba-2dfd-4bb6-8165-2bf639aec2f6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.581347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.582165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.582440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.582730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.600784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:41.610814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:41.612060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 195/388] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:41.617942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.626494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.627420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.627702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.627980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.629903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:41.631438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:41.634967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 194/389] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:41 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:41.638771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:41.764267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f85c3-c75c-45fe-960a-464759802ed0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.799904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.800808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.801096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.801375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/groups/87375e499f984b0ba312e05eddbcbb5b/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.803801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, group_id=87375e499f984b0ba312e05eddbcbb5b, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:41.805455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:41.814671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0b7ef-a0e5-4746-a5d6-ea26ba102717 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:41.831214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 195/390] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Apr 1 09:50:41 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/groups/87375e499f984b0ba312e05eddbcbb5b/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:41.854397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:41.855226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:41.855498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:41.855771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:41.856532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:41.856921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:41.858332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:41.875244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 196/391] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:41.883182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.019083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688b4c9-34ea-464c-9969-adc51687ab1c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.059886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.060783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.061069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.061347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.062582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:42.064113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:42.066139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 196/392] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:41 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:42.071929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.179315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58518-c580-4c38-bf87-5c68bf3a0c07 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.222356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.223288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.223573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.223854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.225083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:42.226549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7d2bd-dafd-4762-b876-3d62e2b98de6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:42.228317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 197/393] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:42.234171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.337153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079928ef-7907-4381-8774-e5c817effea2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.370353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.371282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.371565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.371842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901/groups/87375e499f984b0ba312e05eddbcbb5b/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.374088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] RBAC: Authorizing `identity:create_grant(project_id=768f17a3540d4802bf3dfa3319b69901, group_id=87375e499f984b0ba312e05eddbcbb5b, role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:42.375746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795aabdd-5416-4ebf-93ec-0e21f4fe782f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:42.390578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 197/394] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Apr 1 09:50:42 2022] PUT /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901/groups/87375e499f984b0ba312e05eddbcbb5b/roles/ec45838429e4491ea0215d21e1e01239 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:42.500293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a73-6b16-4cb4-90cc-b1e97c02fd60 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.500595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a73-6b16-4cb4-90cc-b1e97c02fd60 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.500853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51a73-6b16-4cb4-90cc-b1e97c02fd60 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.502831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 198/395] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:42.509079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.509706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.510175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.535632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:42.537265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:42.563296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074786-1bad-4084-9de7-afb7d6796d20 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.563926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074786-1bad-4084-9de7-afb7d6796d20 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.564398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074786-1bad-4084-9de7-afb7d6796d20 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.566743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 199/396] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:42.572228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262b979-e389-472e-8287-e07708d35249 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.572784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262b979-e389-472e-8287-e07708d35249 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.573284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262b979-e389-472e-8287-e07708d35249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.607847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f262b979-e389-472e-8287-e07708d35249 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:42.609372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f262b979-e389-472e-8287-e07708d35249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:42.617383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 198/397] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:42.643791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.691354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 200/398] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:42.715137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262b979-e389-472e-8287-e07708d35249 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.742742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcc6b2-be9f-4c1b-b2e5-a78e65c5e105 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.776662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.777721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.778102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.778474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.789506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:42.796816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:42.798488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 199/399] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:42.804382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.817765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262b979-e389-472e-8287-e07708d35249 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.851220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.852319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.852808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.853258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.863957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:42.871923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:42.873493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 201/400] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:42.883600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.904321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccaa58-aa3a-4af7-a08a-d3d004e64852 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:42.939010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:42.939719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:42.940004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:42.940281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:42.941036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:42.941344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:42.942763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:42.951775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 200/401] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:42.957390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:42.984641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ddc9a4-fde2-49d2-9033-24b9153636bf None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.017673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.018725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.019203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.019713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.020651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:43.021180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.022930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.040071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 202/402] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:43.047752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.094330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df706-b83d-41f4-824e-a6fea2b508a9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.157589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.160125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.160413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.160691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.163083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.164540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.171532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 201/403] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:42 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:43.175724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.207505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4cf39-866c-4acb-8ddb-56da56629868 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.244342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.245336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.245618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.245892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.247262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.248761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.250865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 203/404] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:43 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:43.257228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.361394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad666ad-2542-4936-9a7d-fa308c63b183 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.397975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661439c-5335-4f46-b1ce-e6011c32fe56 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.407540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.408487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.408713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.408989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.410191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.412331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8dbe6-ae9c-4321-b9da-c607d4cf0c6b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.414767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 204/405] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:43 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:43.420657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413139e-3d21-4c8f-995f-61f64f19bfb8 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.420952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413139e-3d21-4c8f-995f-61f64f19bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.421235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413139e-3d21-4c8f-995f-61f64f19bfb8 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.423354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 205/406] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:43.424127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413139e-3d21-4c8f-995f-61f64f19bfb8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.445564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.446620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.446930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.447510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.448735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.450734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c5d2b-ccfe-4ba4-bad6-2b0bdd8e2fd5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.453549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 202/407] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:43 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:43.455750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.456037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.456314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.481203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:43.482615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:43.535585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413139e-3d21-4c8f-995f-61f64f19bfb8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.569306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.569534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 203/408] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:43.570305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.570793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.571132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.571413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/groups/87375e499f984b0ba312e05eddbcbb5b/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.573809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, group_id=87375e499f984b0ba312e05eddbcbb5b, role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.575438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.593384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 206/409] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Apr 1 09:50:43 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/groups/87375e499f984b0ba312e05eddbcbb5b/roles/ec45838429e4491ea0215d21e1e01239 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:43.601744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:43.696328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31e54f-aae2-4fd0-9cbd-be025606133e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.732192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.733147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.733439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.733773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/groups/87375e499f984b0ba312e05eddbcbb5b/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.735834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] RBAC: Authorizing `identity:create_grant(project_id=8509db35eadc4b448cf16ddd3b0f0f82, group_id=87375e499f984b0ba312e05eddbcbb5b, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:43.737633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:43.759891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 204/410] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Apr 1 09:50:43 2022] PUT /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82/groups/87375e499f984b0ba312e05eddbcbb5b/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:43.814988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e008e5a-f259-4b27-9842-53d00705f17c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:43.865026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:43.865780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:43.866063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:43.866338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:43.878353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:43.885639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:43.887357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 207/411] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:43.893072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:44.003619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27165a90-7e92-4849-b72d-c4d13baae6fb None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:44.037420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:44.038101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.038388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.038686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.039799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:44.040157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:44.041594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:44.050872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 205/412] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:44.056467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:44.167408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a2b6b-5a97-4ecd-a4fb-68ae0cd07047 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:44.201453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:44.202331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.202622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.202932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] PATH_INFO: `/v3/groups/074ad9820f864f5d90ae2e46bc61850a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.204132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] RBAC: Authorizing `identity:get_group(group_id=074ad9820f864f5d90ae2e46bc61850a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:44.205711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:44.207715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 208/413] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:44 2022] GET /identity/v3/groups/074ad9820f864f5d90ae2e46bc61850a => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:44.215777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:44.332359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21acd96-4135-475d-9e42-a3743c0d30bd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:44.375347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:44.376236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.376515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.376788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] PATH_INFO: `/v3/projects/049efb42322340008044df453447aaa7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.377976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] RBAC: Authorizing `identity:get_project(project_id=049efb42322340008044df453447aaa7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:44.379522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931075c5-34fa-472e-b9ae-680ff351522c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:44.381300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 206/414] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:44 2022] GET /identity/v3/projects/049efb42322340008044df453447aaa7 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:44.387352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:44.516753 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454517b-74c0-4339-874f-5786ccd02ceb None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:44.557166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:44.558064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.558345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.558671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] PATH_INFO: `/v3/projects/049efb42322340008044df453447aaa7/groups/074ad9820f864f5d90ae2e46bc61850a/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.561931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=049efb42322340008044df453447aaa7, group_id=074ad9820f864f5d90ae2e46bc61850a, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:44.563411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3954-48e3-488f-85ef-6a60629a7b6f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:44.578101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 209/415] 10.222.0.46 () {58 vars in 1442 bytes} [Fri Apr 1 09:50:44 2022] PUT /identity/v3/projects/049efb42322340008044df453447aaa7/groups/074ad9820f864f5d90ae2e46bc61850a/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:50:44.915707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e217f4-c369-40bc-a48f-aa5a8b75e42b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.916409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e217f4-c369-40bc-a48f-aa5a8b75e42b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.916936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e217f4-c369-40bc-a48f-aa5a8b75e42b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.918996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 207/416] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:44.924504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32d80-7250-47ce-a1a5-e05c48e44cfb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:44.925401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32d80-7250-47ce-a1a5-e05c48e44cfb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:44.925874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac32d80-7250-47ce-a1a5-e05c48e44cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:44.943699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fac32d80-7250-47ce-a1a5-e05c48e44cfb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:44.945240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fac32d80-7250-47ce-a1a5-e05c48e44cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:45.012440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 210/417] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:45.057745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e217f4-c369-40bc-a48f-aa5a8b75e42b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.183434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e217f4-c369-40bc-a48f-aa5a8b75e42b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:45.227330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:45.228140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.228423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.228704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.239509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:45.247092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:45.248839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 208/418] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:45.253931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.254249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d436d-437a-4776-89f7-23aee6893ce7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.254921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d436d-437a-4776-89f7-23aee6893ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.255403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d436d-437a-4776-89f7-23aee6893ce7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.257655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 211/419] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:45.262576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.263116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.263596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.298812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:45.300366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:45.387249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1c42-b5bd-4e60-a388-537952cf2f81 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:45.409769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 212/420] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:45.438247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:45.439271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.439775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.440252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.441220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] RBAC: Adding query filter params (name=member) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:45.441752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:45.443450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:45.452062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 209/421] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:45.457407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.474515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.581355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3755e3d-244a-47af-87d1-2537e46010fb None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:45.624961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:45.625622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.625909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.626185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.674084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd70c4b-ff56-42b4-9f81-56949f3ecd12 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:45.708072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:45.710090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:45.741055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:45.743326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.744431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.745521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.762996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:45.774842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:45.779514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 210/422] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:45.788917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.891588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dd38e-00a1-4aef-86c7-42a41ea78f07 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:45.899370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 213/423] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:45.904917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:45.925480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:45.926561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:45.927067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:45.927615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:45.928549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:45.929038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:45.930600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:45.939244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 211/424] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:45.944465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.051437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8560d-d5b3-475e-b7ef-bdca93b1009e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.086529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.087653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.088148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.088738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.160487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.162471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.173136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750803b-1218-450b-80c0-847cb09de513 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.252240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.253127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.253416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.253696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.254986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.256483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.267206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 214/425] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:46.268126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.271533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 212/426] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:50:46.285508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.403564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52436-f1b3-42aa-9e54-ed48965903dc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.465108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.465982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.466273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.466546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] PATH_INFO: `/v3/projects/768f17a3540d4802bf3dfa3319b69901` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.472907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] RBAC: Authorizing `identity:get_project(project_id=768f17a3540d4802bf3dfa3319b69901)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.474476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.477317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2539bf-9689-40ad-a872-cf3656a1a5df None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.487300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 213/427] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/projects/768f17a3540d4802bf3dfa3319b69901 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:46.498567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.536078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.537030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.537319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.537597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.538825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.540288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.546002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 215/428] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:46.553105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.663922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a5c57-3bd1-4237-8418-891698700f2d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.665151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3ee6e-7857-407d-b45d-a44e1fd09a8c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.697878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.698357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.699048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.699384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.699508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.699858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.700055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.700473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.701249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.701698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=768f17a3540d4802bf3dfa3319b69901) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:46.702183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.702901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edeb13-2ded-48f8-86d3-840bf2088a69 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.703998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.704979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 214/429] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:46.706238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae695d2-5bcf-4cbe-8afb-4e11fcaed0ef None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.710807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae695d2-5bcf-4cbe-8afb-4e11fcaed0ef None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.710807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae695d2-5bcf-4cbe-8afb-4e11fcaed0ef None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.713192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 215/430] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:46.715256 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.715753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.716228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.716921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 216/431] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:46.717776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.753309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:46.754550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:46.837147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 216/432] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:46.861029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:46.891623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f6c9-f155-4c69-8af9-280a486d4c75 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:46.931302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:46.932361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.932845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.933342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.934413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=768f17a3540d4802bf3dfa3319b69901) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:46.934997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:46.936700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867931-1bfb-479a-86ff-bb6e1e5491e2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:46.944030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 217/433] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=768f17a3540d4802bf3dfa3319b69901&role.id=ec45838429e4491ea0215d21e1e01239 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:46.945825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc02c-0436-4ef8-b310-126231290c63 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.946315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc02c-0436-4ef8-b310-126231290c63 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.946846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dc02c-0436-4ef8-b310-126231290c63 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.949143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 218/434] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:46.961594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:46.961594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:46.961594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:46.990551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:46.990551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:47.027369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31ecf0-c150-4056-91bc-facf3c31a39c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.063382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 219/435] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:47.068381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.069546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.069994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.070435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.087307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:47.091170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.096661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:47.098337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 217/436] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:47.104524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.196673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efadc0-9446-4d86-a921-21191d7bb72e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.208412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf5410-f406-4be2-b190-077c1ebf3ffe None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.231118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.231924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.232206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.232479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.241981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.242681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.242981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.243262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.243360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:47.244021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:47.244329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.245716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.250395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 01 09:50:47.252003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 220/437] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:47.254798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 218/438] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:47.264151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.264487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.366730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14876c2f-c8a4-4a1a-982a-ce1627cfe2a8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.371202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb58a55-5a2f-42d2-8dca-23f7d0193993 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.404174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.405121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.405410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.405688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.410697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.411377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.411690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.411967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.413504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:47.413812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.415754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e260c-08b9-42a3-b2cf-e0f25c230d05 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.426904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 221/439] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:47.428737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373be6-6aa9-4462-a1e5-f91351cf8da8 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.429262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373be6-6aa9-4462-a1e5-f91351cf8da8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.430120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3373be6-6aa9-4462-a1e5-f91351cf8da8 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.432950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 222/440] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:47.433857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373be6-6aa9-4462-a1e5-f91351cf8da8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.484890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.486380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae9bf-106d-428a-a0a4-e21c306683d7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.547240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3373be6-6aa9-4462-a1e5-f91351cf8da8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.579321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.579971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.580256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.580535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.592935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 219/441] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:47.594221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.594551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.594817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.610678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:47.611900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:47.645294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.646834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.675033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 220/442] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:47.675844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.744679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:47.745417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.770405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af3e5e-cf5a-407d-a2e6-144ffbc8d223 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.804118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.805008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.805290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.805548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.806793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.808228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.809915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 221/444] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:47.810684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.840557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455298ed-7155-45b1-b7c0-0180efd2f258 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.871916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.872703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.873047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.873318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.883345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:47.890180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:50:47.891568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 224/445] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:47.892133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.913594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7335e01-4ae1-49c1-9a16-577e50263745 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:47.949875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:47.950994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:47.951279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:47.951558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] PATH_INFO: `/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:47.952764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] RBAC: Authorizing `identity:get_project(project_id=8509db35eadc4b448cf16ddd3b0f0f82)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:47.954218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:47.955946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 222/446] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/projects/8509db35eadc4b448cf16ddd3b0f0f82 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:47.956701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:47.987563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359fb30-9902-4517-8e17-1eb53577c54b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.018589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.019412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.019692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.019964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.021207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.022632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.024317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 225/447] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.025107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.058055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76a559-f998-4994-84dd-485513aadf9c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.091137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.091808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.092092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.092365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.093132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:48.093447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.094918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.103945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 223/448] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.104812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.122119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebe009-ffd8-45af-940c-ddeae0ae24b3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.155213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.156439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.156715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.156980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] PATH_INFO: `/v3/groups/87375e499f984b0ba312e05eddbcbb5b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.158158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] RBAC: Authorizing `identity:get_group(group_id=87375e499f984b0ba312e05eddbcbb5b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.159687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.161534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 226/449] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/groups/87375e499f984b0ba312e05eddbcbb5b => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.162130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.204079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2009d-aa15-4033-bbf6-9f03198e91b3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.236551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.237196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.237481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.237755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.238594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:48.238976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.240499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.246090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 224/450] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=ec45838429e4491ea0215d21e1e01239 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.246889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.252788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876f093-ec1b-4997-befd-db00c0ced6ce None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.288706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.289294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.289580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.289857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.361747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.363300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.370096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a143c-1b40-477f-b423-d37c64226c4e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.406847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.407524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.407803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.408075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.408916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] RBAC: Adding query filter params (group.id=87375e499f984b0ba312e05eddbcbb5b, role.id=093bf7d1ef5340058d9e975518b94a39, scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:48.409222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.410744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.417211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 225/451] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/role_assignments?group.id=87375e499f984b0ba312e05eddbcbb5b&scope.project.id=8509db35eadc4b448cf16ddd3b0f0f82&role.id=093bf7d1ef5340058d9e975518b94a39 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.469133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 227/452] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:48.475147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.578084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d980e-b822-4d6a-8813-4c402fb19bc8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.613598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.614475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.614816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.615094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] PATH_INFO: `/v3/projects/049efb42322340008044df453447aaa7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.616271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] RBAC: Authorizing `identity:get_project(project_id=049efb42322340008044df453447aaa7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.617712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.619590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 226/453] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/projects/049efb42322340008044df453447aaa7 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.625731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.722771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6549a9-5684-4978-b5d3-b65d701e8921 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.755898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.756754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.757038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.757313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] PATH_INFO: `/v3/groups/074ad9820f864f5d90ae2e46bc61850a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.758483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] RBAC: Authorizing `identity:get_group(group_id=074ad9820f864f5d90ae2e46bc61850a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.759970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a91ad-a75a-467e-9086-9c35a3c1bdcb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.761932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 228/454] 10.222.0.46 () {56 vars in 1180 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/groups/074ad9820f864f5d90ae2e46bc61850a => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:48.767917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:48.866218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74faa8-4599-49cc-837d-37a76dabb831 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:48.898372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:48.899040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:48.899327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:48.899608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:48.900443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] RBAC: Adding query filter params (group.id=074ad9820f864f5d90ae2e46bc61850a, role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=049efb42322340008044df453447aaa7) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:48.900750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:48.902204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79db20-1214-41f1-a2f8-d295090ad066 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:48.908395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 227/455] 10.222.0.46 () {56 vars in 1376 bytes} [Fri Apr 1 09:50:48 2022] GET /identity/v3/role_assignments?group.id=074ad9820f864f5d90ae2e46bc61850a&scope.project.id=049efb42322340008044df453447aaa7&role.id=f9d36af787804f248e9bea8324501c2a => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:51.723245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6290f5-4c8f-47df-859d-551dee337fbc None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.723759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6290f5-4c8f-47df-859d-551dee337fbc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.723833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6290f5-4c8f-47df-859d-551dee337fbc None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.725873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 229/456] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:51.731491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.731914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.732088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.759725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:51.760826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:51.774935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fd6d-60a4-44f1-a625-111e3ca77107 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.775218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fd6d-60a4-44f1-a625-111e3ca77107 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.775494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fd6d-60a4-44f1-a625-111e3ca77107 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.777493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 230/457] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:51.786327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7ddc-3fdb-4da8-948a-e5504c11c2db None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.786695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7ddc-3fdb-4da8-948a-e5504c11c2db None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.786974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c7ddc-3fdb-4da8-948a-e5504c11c2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.810608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-bb3c7ddc-3fdb-4da8-948a-e5504c11c2db None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:51.811852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bb3c7ddc-3fdb-4da8-948a-e5504c11c2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:51.859848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 228/458] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:51.884432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:51.916055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 231/459] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:51.943784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ef68-e0bf-4dbe-8608-4e406eebe436 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.944069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ef68-e0bf-4dbe-8608-4e406eebe436 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.944353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ef68-e0bf-4dbe-8608-4e406eebe436 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.946401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 232/460] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:51.951359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:51.951649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:51.951927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:51.971851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:51.973039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:52.018054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9267b0-1164-49ac-b107-7a37a60ac8c8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.046909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 233/461] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:52.047843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.051772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.052649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.052935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.053209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.063241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.064718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.081532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:52.083122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 229/462] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:52.087297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.174094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eade6-10f9-4e6f-a67c-57c60619df70 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.201658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac168f-02e9-4b72-b196-966af9cc4f0a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.207929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.208948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.209329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.209698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.220103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.221827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.234588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.235741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.236029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.236305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.239668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:52.241329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 234/463] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:52.242210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.251196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.252672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.270211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:52.274975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 230/464] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:52.275818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.340959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a899c-d3f1-4b6a-bc00-688c05fa4ebb None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.373565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8088-f1ab-4c19-90e2-b4d3daeb3914 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.375521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.376292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.376672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.377045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.377871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:52.378273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.379807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.392309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 235/465] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:52.393417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.407327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.407996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.408285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.408564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.409301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:52.409607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.411040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.428738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 231/466] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:52.429556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.504364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee09a-6f65-4ff8-b067-dca5807b9b37 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.533337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38249022-cf76-4c39-8b6b-22c792c43301 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.541736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.542415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.542729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.543012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.543736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:52.544044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.545443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.563209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 236/467] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:52.563786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.565620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.566306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.566588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.566892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.567738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.569191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef5e14-ac34-4f9d-b1d5-41001ad49bd6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.590505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 232/468] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:52 2022] POST /identity/v3/users => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:52.591967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c4e8-d563-4f97-b26b-0917f2fcc139 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.592327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c4e8-d563-4f97-b26b-0917f2fcc139 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.592591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50c4e8-d563-4f97-b26b-0917f2fcc139 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.594507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 233/469] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:52.595172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50c4e8-d563-4f97-b26b-0917f2fcc139 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:52.689544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed09a2-6b78-4221-a4fa-91dee41471e9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.728336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.729353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.729353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.729621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.730326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.732088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840069-3bae-4338-8b2e-aa6434015e16 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.742736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50c4e8-d563-4f97-b26b-0917f2fcc139 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:52.762752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 237/470] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:52 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:52.762752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.762752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.762752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.797098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:52.798269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:52.812599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:52.813565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:52.814045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:52.814459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:52.815391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:52.817083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:52.847416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 234/471] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:52 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:52.879349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 238/472] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:52.906084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.023280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b832d6f-8982-4e0a-8e10-a99c928c88af None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.063777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.064540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.064822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.065094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.078703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:53.080685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:53.098379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f7955c5a-3d4f-4ef1-98ba-b3b3a3e70542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:53.100410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 235/473] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:53.106145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.113513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfefec5-08ac-49a4-89c1-1b13f7f271c9 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.114146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfefec5-08ac-49a4-89c1-1b13f7f271c9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.114690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfefec5-08ac-49a4-89c1-1b13f7f271c9 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.117513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 236/474] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:50:53.123471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.124094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.124581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.148400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:53.149618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:53.218218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 237/475] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:53.231722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98511f37-2c0d-4a40-9e1e-7857cb0f6396 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.242541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.270063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.270881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.271169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.271443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.272226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:53.272534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:53.273920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:53.294866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 239/476] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:53.303313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.353725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993061e8-aebc-49f2-9ce7-b9936e33565d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.389593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.390265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.390548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.390869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.391619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:53.393007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:53.400385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.sql.core [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 01 09:50:53.400385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 01 09:50:53.400385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [parameters: {'id': '862e5d1fba874dbcac51270616e40f15', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 01 09:50:53.400385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79776) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 01 09:50:53.416786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 01 09:50:53.422291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 238/477] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Apr 1 09:50:53 2022] POST /identity/v3/roles => generated 144 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:53.425260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.437312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72ce1-fb52-4656-96b1-440764b75b58 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.509045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.509759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.510093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.510376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.511122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:53.512563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:53.531579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62172754-c540-4e40-9f23-523b242d34ee None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.545786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 240/478] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:53 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:53.565769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.566595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.566917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.567197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.579228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:53.586780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-80a3e757-3e99-4e7f-8092-7df7ea2091e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 01 09:50:53.588352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 239/479] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:50:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:53.594161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:53.722965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee836c7b-a8b3-4a8e-b312-dd3ba0656125 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:53.759344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:53.760133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:53.760381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:53.760664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:53.761443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:53.761752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:53.763212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251ac6a-2b2c-47e7-8e54-a20fb4a3e719 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:53.773017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 241/480] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:55.433621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b79-9f80-44bb-96f5-2fd0ac59e436 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.434640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b79-9f80-44bb-96f5-2fd0ac59e436 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.435159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70b79-9f80-44bb-96f5-2fd0ac59e436 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.437439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 240/481] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:55.442230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30357e-0e71-4f80-9afa-a78a8cacad8d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.443115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30357e-0e71-4f80-9afa-a78a8cacad8d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.443592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30357e-0e71-4f80-9afa-a78a8cacad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.470714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-af30357e-0e71-4f80-9afa-a78a8cacad8d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:55.472226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-af30357e-0e71-4f80-9afa-a78a8cacad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:55.569365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 242/482] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:55.606855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70b79-9f80-44bb-96f5-2fd0ac59e436 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:55.676381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f48d8-724a-4352-a325-2aa3b2e67b85 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.677103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f48d8-724a-4352-a325-2aa3b2e67b85 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.677574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f48d8-724a-4352-a325-2aa3b2e67b85 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.680991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 243/483] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:55.685318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.685826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.686298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.723859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:55.724802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70b79-9f80-44bb-96f5-2fd0ac59e436 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:55.727348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:55.806429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:55.807274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.807555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.807828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.828389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:55.836356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 244/484] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:50:55.847830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:50:55.849312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 241/485] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:55.854810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:55.868935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:55.953401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1233b5-78d7-4906-a9c8-58cece8c0f47 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:55.989729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:55.990406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:55.990712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:55.990996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:55.991755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:55.992062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:55.993449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.012884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 245/486] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:56.020132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.070166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda063e-41c1-4524-b22f-1d77e44603ca None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.110567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.111406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.111685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.111953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.131723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:56.138785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:50:56.140012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 242/487] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:50:56.147419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.181108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929ff5-6f9e-4bc9-9750-b5462898abd4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.216737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.217456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.217736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.218009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.231639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.233624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.254894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-53457e20-8963-4fd3-b7d1-a0faae9beeb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:56.256665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 246/488] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:56.258017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c01-1a50-46aa-a5a0-5b5dc165617f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.258298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c01-1a50-46aa-a5a0-5b5dc165617f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.258570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850c01-1a50-46aa-a5a0-5b5dc165617f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.267522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 247/489] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:56.268402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850c01-1a50-46aa-a5a0-5b5dc165617f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.291139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62666-e2d8-4b9f-94c4-a90725170047 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.328900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.330037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.330449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.330754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.331722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:56.332032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.334243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0fc3-89e3-471a-9d5b-d9338a3391f9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.345477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 243/490] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:50:56.347338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.347873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.348161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.374048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:56.375900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:56.383765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850c01-1a50-46aa-a5a0-5b5dc165617f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.420006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.420675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.421003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.421284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.422012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:56.422751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.424549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.438629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 248/491] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:56.439543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.451876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 244/492] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:56.452837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.547661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d2718-feff-4ebf-9fde-bb51c8ab06f2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.550669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffa753-5aa4-4a97-834d-b2b155e4f494 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.579101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.579897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.580180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.580449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.582966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.583858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.584135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.584403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.587647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.589128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.595691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.597409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.603621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a5711666-0d10-421d-94a7-2b6e382e6d75 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 01 09:50:56.604834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 245/493] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:56.606129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7919-b164-42ba-a21f-2bc5165205f9 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.606418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7919-b164-42ba-a21f-2bc5165205f9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.606713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7919-b164-42ba-a21f-2bc5165205f9 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.610916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 246/494] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:56.611708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7919-b164-42ba-a21f-2bc5165205f9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.615899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:56.617336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 249/495] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:56.618294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.709345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7919-b164-42ba-a21f-2bc5165205f9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.711597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738d15-0993-4cd4-ae3f-f7ba0a431702 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.742365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.743107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.743387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.743661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.744496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.745201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.745489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.745765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.746620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:56.746969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.748422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.753319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:56.760270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-e746ac58-31c9-4037-b9c4-f8651540f70b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:50:56.761492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 247/496] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:56.762617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3e3d-8da7-40f4-8c8a-492b57a22d38 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.762948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3e3d-8da7-40f4-8c8a-492b57a22d38 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.763181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3e3d-8da7-40f4-8c8a-492b57a22d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.779645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-388f3e3d-8da7-40f4-8c8a-492b57a22d38 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:56.781188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-388f3e3d-8da7-40f4-8c8a-492b57a22d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:56.785728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 250/497] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:56.786680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.846955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 248/498] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:56.848300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835f51-9a65-481d-b91b-0da8a9897986 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.848587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835f51-9a65-481d-b91b-0da8a9897986 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.848900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b835f51-9a65-481d-b91b-0da8a9897986 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.850588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 249/499] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:50:56.851396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b835f51-9a65-481d-b91b-0da8a9897986 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.900118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff1b0c-2289-49aa-84c2-6e8fb034996c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.931689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.932340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.932619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.932891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.933627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:56.933925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.935356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.946120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 251/500] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:56.946866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:56.948370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b835f51-9a65-481d-b91b-0da8a9897986 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:56.982264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:56.982969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.983254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.983533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:56.984277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:56.984582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:56.985978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3828dfc-0b9c-4016-87f2-9d5ae10cd18e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:56.993758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 250/501] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:56.994966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:56.995244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:56.995523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.011334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:50:57.012519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:50:57.038748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a737e0-82f7-41ba-92e2-7906e2ed5a73 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.070008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.070669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.070963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.071240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.075799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 251/502] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:50:57.076632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.136670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.138126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.168637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c9f6b-54a1-46da-8587-7b48aa8d26c6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.201466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.202281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.202559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.202863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.212977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:50:57.220040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:50:57.221272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 252/503] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.222027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.229089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 252/504] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:57.229910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.321893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc1fe-95b6-434d-aee0-84147a1583d3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.323992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059fbe-7259-4350-a59c-c556b5f84287 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.354879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.355653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.355776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.355932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.356213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.356550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.356832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.357102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.363522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.365079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.366778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.368251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.378016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:50:57.379230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 253/505] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.380022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.384521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:57.389582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 253/506] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.389582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.473250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907a13-c384-43d8-a250-bf1704615f0a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.489787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f87a3a-fc3d-4070-808d-7eb0ff64c504 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.505749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.506617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.506933 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.507204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.518172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.519681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.521208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.521879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.522164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.522449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.523236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:57.523552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.524926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.532973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 254/507] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:57.533771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.536049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:57.537447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 254/508] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.538903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.627870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46bc9c-4070-4c0f-9638-604d9e911373 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.629215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ba58-bef3-4906-b083-f928209eb7a9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.660685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.661282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.661546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.661829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.661934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.662085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.662176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.662408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.663280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:57.663585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.665022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.672258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.673710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.690236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:57.691446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 255/509] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.692231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.700989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 255/510] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:57.701814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.783821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76456ee9-95cd-43a3-93fc-213fdd1e98e0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.802167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1d39-6eed-41f1-a2a8-5b75430d6178 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.815799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.816467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.816742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.817008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.817787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:57.818091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.819510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.831291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 256/511] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:57.832213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.834736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.835600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.835972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.836308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.846422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.847936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.864932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:57.866114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 256/512] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:57.870825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.927876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084bd43-014a-48eb-900c-fdd2b2cfd4bb None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.960133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e3d51-8bf2-4fac-9fad-777fb2d00106 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:57.960580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.961235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.961521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.961798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.962529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:57.962865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.964244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:57.975321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 257/513] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:57.976113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:57.992099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:57.992767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:57.993048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:57.993322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:57.994052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:57.994342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:57.995752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.006398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 257/514] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:58.007216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.072226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729eb77-8074-409a-8063-e0cbff15a070 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.103021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.103666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.103950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.104226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.105351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f446-4249-4e25-b186-09621a78a6c7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.136299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.137098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.137384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.137657 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.144848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.146366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.159710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 01 09:50:58.160884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 258/515] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:58.161739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.169484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.171004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.258066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7940-53e8-4f00-9fce-f0a20532a819 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.263931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 258/516] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:58.264750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.292961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.293626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.293911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.294185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.294935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:58.295242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.296613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.307886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 259/517] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:58.308675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.356694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef260d-0711-432c-bca4-0decc30c878e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.390019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.390767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.391034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.391313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.392026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.393487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.405082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef583eab-e93e-4c6d-bab3-b7f76581672c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.414511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 259/518] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:50:58 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:50:58.415377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.440297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.441524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.442003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.442561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.452538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.455028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.469297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:50:58.470959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 260/519] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:58.471981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.520802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206455f-ed74-440e-93c4-64b0a653979f None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.556642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.557777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.558267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.558628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.559590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:58.559973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.561551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.578556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6563d08-eec6-4001-b65e-46a31a38a731 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.581060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 260/520] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:58.582285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.614212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.615891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.615891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.616074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.627436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.628988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.646380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:58.647796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 261/521] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:58.648501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.682526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e62428-4ce7-4eaf-88f6-bd72638694ea None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.715648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.716461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.716735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.717017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.724812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.726287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.740469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 01 09:50:58.746280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 261/522] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:58.746280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.751806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa6556-e7e0-4836-8a00-1464cfe84839 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.785262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.785860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.786173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.786451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.787275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:58.787585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.789029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.811114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 262/523] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:58.811114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:58.845532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be37c3a-54cc-4e9e-9c0e-6604956f1850 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.878905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.879562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.879846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.880136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.908779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f3fa-49bb-4c3d-a192-276d9f5f7db0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:58.941745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:58.942558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:58.942892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:58.943171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:58.943910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:58.944201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.945585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.946324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:58.948013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:58.956330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 263/524] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:58.957134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.044466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 262/525] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:59.045174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.051952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf03f1-739e-418d-8499-7bb0f3cb64ba None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.084913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.085839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.086287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.086752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.087760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:59.088231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.089840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.111295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 264/526] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Apr 1 09:50:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:59.111295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.141242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe466-8256-479a-b93d-7d853df86c74 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.173462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.174157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.174443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.174746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.175582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=aba5e29ac89d4fd19a1c882830c2ef1e) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:59.175890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.177366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.190676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 263/527] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/role_assignments?user.id=aba5e29ac89d4fd19a1c882830c2ef1e&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:59.190676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.214845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69e42-5e23-4f09-bb14-b68462a2d698 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.250503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.251358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.251642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.251914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.259769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.261337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.275679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:50:59.277374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 265/528] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:59.278296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.293197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275257-a99e-445c-8223-ca89e60cf3ef None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.329343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.330065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.330348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.330626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.345856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.348248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.374048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:59.375749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 264/529] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:59.376702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.396497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c8bef-f77f-451b-9d98-6c830e13f658 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.451615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.452404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.452714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.453000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.495505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26fe5-d525-481c-a01c-528693500991 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.521778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.523320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.529929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.531261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.531739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.532195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.533162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:59.533656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.535314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.553047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 265/530] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:59.554199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.624080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 266/531] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:50:59.625011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.654933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9c75a-799f-41a6-be0f-255cbae6b243 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.690755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.692188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.692707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.693168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.694086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:59.694586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.696169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.707331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 266/532] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:59.708390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.725040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f37c7f-7c13-4c64-b65d-92071a026689 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.758388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.759163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.759452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.759789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.760607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:50:59.760926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.762475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.768052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 267/533] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:50:59.768843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.806810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca49d6a-6c52-43d0-981e-40a6212b320b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.841622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.842866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.843344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.843828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.855034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.857600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.872002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469aad-2fbe-4e3e-b90a-374155aeb106 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:50:59.880063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:50:59.881809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 267/534] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:59.887765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:50:59.907348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:50:59.908340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:50:59.908525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:50:59.908809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:50:59.917634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:50:59.919219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:50:59.933258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:50:59.934930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 268/535] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:50:59.940956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:00.010452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625658d6-9577-40d3-854a-035472ca18a3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.046882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721b42e-e24a-4024-a31a-08519f220593 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.052750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.053777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.054279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.054789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.055726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:00.056231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.057880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.071172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 268/536] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:00.076731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:00.081299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.081847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.082132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.082418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.083367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:00.083683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.085157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.098417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 269/537] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:00.104558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:00.196342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7eb7-5509-4b95-9b17-3632c839c418 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.209895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177506d-cd73-4e36-8ea2-1308b8e379d7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.237246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.238899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.239690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.240152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.250894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.250894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.250894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.250894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.251288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a1ac29fcbcdc4bcfacfa2695a3bba6eb) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:00.251288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.251288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.257907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 270/538] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:00 2022] GET /identity/v3/role_assignments?user.id=a1ac29fcbcdc4bcfacfa2695a3bba6eb&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:00.258366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.260046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.275388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:00.277376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 269/539] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:00.283580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:00.429252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee01d8a-bdf9-4245-b033-7dea8d3872a4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.489947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.489947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.489947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.489947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.490342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:00.490411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.492433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12d9f4-c179-4cb6-a63b-6c78459ab27c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.518281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 271/540] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:00.525958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:00.659447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12553490-cfbd-46aa-b998-d566d6c96543 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:00.702835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:00.704270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.704745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.705232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.706263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=2c8f234c44684cdfa836b64c3c87fc39) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:00.706791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:00.708434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfedef-e887-4cad-8ca0-4f50176d9b5f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:00.718541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 270/541] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:00 2022] GET /identity/v3/role_assignments?user.id=2c8f234c44684cdfa836b64c3c87fc39&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:00.819921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001624ba-0ef6-475d-8448-23add2f72f40 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.820435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001624ba-0ef6-475d-8448-23add2f72f40 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.820435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001624ba-0ef6-475d-8448-23add2f72f40 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.822579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 272/542] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:00.828594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:00.829203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:00.829693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:00.864948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:00.866750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:00.949531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 271/543] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:00.985186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001624ba-0ef6-475d-8448-23add2f72f40 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:01.104438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001624ba-0ef6-475d-8448-23add2f72f40 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:01.149476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:01.150291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:01.150577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:01.150897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:01.167523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:01.174546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:01.176130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 273/544] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:01.181804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:01.328183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91413c-16e7-432a-b2e5-145b6fde134d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:01.377411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:01.378352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:01.378798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:01.379204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:01.380197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:01.380634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:01.382143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:01.393897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 272/545] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:01.399791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:01.498594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a2c28-3f29-4a2a-b444-74672250bb09 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:01.538170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:01.539040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:01.539327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:01.539604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:01.550674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:01.552271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:01.578331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:01.579940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 274/546] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:01.585243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:01.741340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef75c3-1467-4d66-bdba-6907cfb83608 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:01.786343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:01.787047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:01.787330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:01.787605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:01.788340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:01.788642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:01.790036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:01.803662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 273/547] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:01.808747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:01.935334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a62637-1d08-4430-a577-9c2696d33734 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:01.975178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:01.976021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:01.976304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:01.976580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:01.988660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:01.990150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:02.007397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-59a580be-4b44-43cb-a80c-5f2c49ea0fe2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:02.008586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 275/548] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:02.015100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.105985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaccf-3725-4f22-b4be-24f67ae2c241 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.106324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaccf-3725-4f22-b4be-24f67ae2c241 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.106554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaccf-3725-4f22-b4be-24f67ae2c241 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.108628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 276/549] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:02.113613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.113905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.114217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.117004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118bb73-4697-4967-bc97-27462f56a5e9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.143753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:02.144972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:02.150131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.150837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.151122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.151395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.152234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:02.152537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:02.153983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:02.179246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 274/550] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:02.184705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.261394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 277/551] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:51:02.286106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.382203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477259-bce2-49eb-a93b-ad02728ae3e6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.387954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e84d-667f-4eae-b802-5b5437ed19c5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.431688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.432504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.432784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.433061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.452485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:02.454516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.455191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.455474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.455749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.469672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:02.471670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 278/552] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:02.478493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.591875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:02.593271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7460e0-b58d-4aca-aa91-681bff960860 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:02.606778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2deb7a-f1d9-4f21-af48-466128347713 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.641963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.642660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.642949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.643289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.644042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:02.644411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:02.645853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:02.655086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 279/553] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:02.661454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.769446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99319d8-88c1-4811-8299-32faf53ff19a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.809680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.810260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 275/554] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:02.810740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.810815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.811076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.811676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03685-dc09-481e-be3c-173a3d051473 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.811958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03685-dc09-481e-be3c-173a3d051473 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.812231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b03685-dc09-481e-be3c-173a3d051473 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.818204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 276/555] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:02.818988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b03685-dc09-481e-be3c-173a3d051473 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.828170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:02.830023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:02.851455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6b552f60-a3a7-42cc-9444-0002755301bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:02.853028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 280/556] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:02.855150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.855437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.855724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.878057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:02.879294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:02.930050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b03685-dc09-481e-be3c-173a3d051473 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:02.956213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 281/557] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:02.957142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:02.975316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:02.976119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:02.976587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:02.976870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:02.995232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:02.996743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.016990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:03.018539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 277/558] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.019449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.071866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30fdfa-fac3-4a71-99d5-79a697ec12d8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.119708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.120306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.120590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.120787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c8284-0a1f-430c-97a4-0e7faec2a416 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.120899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.121579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:03.121885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.124245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.138465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 282/559] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:03.139509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.154507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.155473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.156155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.156571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.168079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:03.175578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:03.182452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 278/560] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.183582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.258335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11129a23-bb46-4eee-acdf-abc9448cfed6 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.285192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e2a9a-4a44-405d-b137-2a88f54f4ab1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.297760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.298434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.298746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.299224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.299750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:03.300058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.301436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.312882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 283/561] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:03.313663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.322950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.323932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.324350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.324757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] PATH_INFO: `/v3/users/glance` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.332381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.333963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.346996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-63f3a3ae-1a82-437b-82d7-74a28920817b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 279/562] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621955-e681-4b91-9d86-9a8089120955 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621955-e681-4b91-9d86-9a8089120955 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4621955-e681-4b91-9d86-9a8089120955 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 280/563] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:03.352791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621955-e681-4b91-9d86-9a8089120955 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.415670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89068870-cb31-418e-addc-853038a8a9ec None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.452139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.452811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.453087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.453338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.454103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:03.454405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.455811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.463688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 284/564] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:03.464475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.474963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4621955-e681-4b91-9d86-9a8089120955 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.509490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.510284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.510564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.510863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.517573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.519059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.532284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8afd89a5-dc86-4261-8dfb-9debbda36c99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:03.533485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 281/565] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.534684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.534976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.535231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.551368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:03.552585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:03.567881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3025a-9cdb-4676-bfbb-4f175b047e9a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.599404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.600070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.600351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.600624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.601448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:03.601751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.603198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26684a-ae5c-475b-9344-0f4ab4131c3b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.613587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 282/566] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:03.614493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.620023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 285/567] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:03.621119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f12d-00e0-4e39-93b9-7edd55abf6bf None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.621403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f12d-00e0-4e39-93b9-7edd55abf6bf None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.621677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f12d-00e0-4e39-93b9-7edd55abf6bf None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.627025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 286/568] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:03.627025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f12d-00e0-4e39-93b9-7edd55abf6bf None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.714603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a4e5f-87a5-404c-bc35-ac130e6612d4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.722111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f12d-00e0-4e39-93b9-7edd55abf6bf None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.753239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.754037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.754319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.754574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.755887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.756551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.756833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.757303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.758120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:03.758426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.759946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.767222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.768849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.773723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 287/569] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:03.774575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.788450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-114cba33-3042-4d98-b0c0-792051f7e410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:03.789664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 283/570] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.790869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.791157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.791460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.808869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:03.810056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:03.882784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 284/571] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:03.882784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.883495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d04cbd-8427-4a25-9bfe-03bdcdbfeb05 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:03.908554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:03.909361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:03.909649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:03.909925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:03.920062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:03.921524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:03.937306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:03.938475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 288/572] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:03.939268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:03.980217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64445ac6-6e49-45ac-bed4-af60031dc718 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.012159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.012924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.013242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.013509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.023313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:04.030258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:04.031775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 285/573] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.032610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.035850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2d674-a196-4960-969d-29901dd4e18e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.068361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.069035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.069321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.069602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.070426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a3b5af1ed1a34c219c29b23c6ee49ce4) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.070784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.072220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.077514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 289/574] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:03 2022] GET /identity/v3/role_assignments?user.id=a3b5af1ed1a34c219c29b23c6ee49ce4&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.078300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.136811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c797b8-cee5-463e-8eb2-3dd5adc2c58a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.172841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.173523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.173811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.174095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.174863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.175172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.176619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.187971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e8ab1-f55c-4ce8-850d-511adba98654 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.193947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 286/575] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.193947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.222205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.223086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.223446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.223747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.235067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:04.242394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:04.243704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 290/576] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.244494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.292874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f027f4d-c8f9-49ec-9e3b-c742ac89a9a2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.324472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.325141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.325424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.325700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.326419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.326757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.328140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.339052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 287/577] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.340115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.353469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa9cbd-5561-4f0e-94f5-6586e565296f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.388479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.389158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.389441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.389717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.390463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.390798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.392176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.404584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 291/578] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.404584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.435485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa32bbe-daf3-4978-ac34-5a92540d8a8a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.467920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.468725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.469011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.469287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.477906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.479415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.492717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:04.498803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 288/579] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.498803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.506030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd58a-b685-4c9e-8da9-a18deefef2b3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.539594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.540261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.540554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.540828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.541581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.541890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.543304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.551061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 292/580] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.555856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.599321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b861-15e1-4b01-9dcc-dc2e118bd7a8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.631188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.632028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.632320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.632593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.639664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.641104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.643841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee498ef-bfbb-44de-99a7-5595e634421e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.654254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:04.656003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 289/581] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.657635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.676314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.677223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.677511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.677789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.689148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.690600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.706661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:04.707934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 293/582] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.712580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.755413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6f44e-a5fd-4bdd-b8b1-7e6573799aae None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.788030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.788679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.788958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.789231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.790061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.790369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.791848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.809668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62eac0d-5ca3-474d-a45b-f19a77c3dc23 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.813073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 290/583] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.814010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.842078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.842922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.843215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.843488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.855990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.857709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.878788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:04.885118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 294/584] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:04.885118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.911513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fecbe6-ea3d-4b07-9959-273b30805f97 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:04.944190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:04.944855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:04.945132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:04.945404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:04.946185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:04.946489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:04.947939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:04.964341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 291/585] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:04.964341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:04.981283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8e084-4bfa-4c71-9694-0a74f11c32db None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.015398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.015976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.016261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.016518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.017237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.017537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.018925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.035373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 295/586] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.035373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.059017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b48f9-644e-4da8-8d24-3e33776db81b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.092989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.093786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.094082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.094345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.108226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.109991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.128226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cafc0-ef41-4d5a-986b-64d81a3038b6 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.128746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:05.129918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 292/587] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:05.130518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.167185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.167944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.168286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.168567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.169323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.169636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.171046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.182267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 296/588] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.183183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.238013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a302-69ef-42a6-8f35-f6ba87e17ea2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.274977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.276631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.277345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.277816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/aba5e29ac89d4fd19a1c882830c2ef1e/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.278863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e6cca-6479-45e5-bd7c-a63be9e0d407 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.296046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=aba5e29ac89d4fd19a1c882830c2ef1e, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.298266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.311773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.312583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.312864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.313136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.315386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 293/589] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:05 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/aba5e29ac89d4fd19a1c882830c2ef1e/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:05.316933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.320905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.322407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.341346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 01 09:51:05.342851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 297/590] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:05.343452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.455085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0a6e4-5c99-47a7-8dd0-309bf0f78aaa None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.473958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add02781-956c-43e6-950a-3e02c9a009c9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.501540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.502606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.503146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.503642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.504645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.505197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.507122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.522578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 294/591] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.522923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.523818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.524112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.524386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.524693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.534847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.535911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.550057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 01 09:51:05.551655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 298/592] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:05.552515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.633799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d76f65-b7df-4321-86c1-4df4d692cf4d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.655176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c812fe-575c-46d9-a534-b4bcd5287e70 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.667306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.667992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.668277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.668554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.669394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.669705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.671188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.688948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 295/593] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.689136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.689859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.690030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.690263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.690541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.698255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.699805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.713896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:05.715517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 299/594] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:05.716476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.786410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa4eab-fe9a-417d-a1e1-1ba30465384a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.813457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3a038-902c-477f-8bef-31dfd8398eda None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.819306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.819992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.820274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.820551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.821386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.821696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.823180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.840511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 296/595] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.841343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.847481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.848301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.848639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.848918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.859516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.861093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.878478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:05.880112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 300/596] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:05.881062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:05.937451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda34e-12fc-4235-84a7-a40c5aa2241e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.970941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:05.971606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:05.971894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:05.972173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:05.972961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:05.973271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:05.974783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:05.977263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e076-952f-4b62-99cf-2747f8990868 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:05.986724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 297/597] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:05.987599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.012211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.013072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.013358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.013684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.026095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.027705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.046249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:06.047820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 301/598] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:06.048813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.089522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe015fc0-a81c-4474-9d83-9d0f69008307 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.122427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.123133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.123415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.123700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.124422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:06.124733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.126107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.142565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 298/599] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:06.142565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.178686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba324f-1a22-46e0-8c2c-784109b83aab None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.212565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.213625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.214024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.214390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.229016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=e04e4b6a2827449dbe36886a303f7a10, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.230691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.240566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1f60-f94f-405f-8d32-2ba563ce35ef None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.247681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 302/600] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:06 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:06.248643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.278759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.279550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.279839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.280115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.281467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:06.281785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.283251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.306561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 299/601] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:06.313446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.370551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603d49-e54d-4b68-86fb-4cf177889e19 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.410598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.411746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.412028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.412299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.420706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.422638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.437838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-24aadbc8-513f-4c69-b0fa-679bbff30af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:06.439279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 303/602] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:06.440585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949068e-6905-4cd0-95d8-e26f95fffbbc None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.440790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949068e-6905-4cd0-95d8-e26f95fffbbc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.441025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949068e-6905-4cd0-95d8-e26f95fffbbc None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.443087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 304/603] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:06.446599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949068e-6905-4cd0-95d8-e26f95fffbbc None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.480593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbc0e-dc1d-4234-9471-5194998b5f37 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.515749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.517393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.517592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.517874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.526083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.527686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.543486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-f9a0c16d-8c85-4cea-bd39-4ce43458846a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:06.545187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 300/604] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:06.551160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.551480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.551817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.559252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949068e-6905-4cd0-95d8-e26f95fffbbc None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.573365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:06.574901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:06.599121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.599885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.600243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.600595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.601457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:06.601833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.603380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.615705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 305/605] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:06.616664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.649652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 301/606] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:06.650805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.760738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccef09e-14b9-4184-8b27-f0379f634ca1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.764713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352a5a1-5258-40c1-8930-4d8d3eb284a8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.794205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.794882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.795171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.795453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.796243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:06.796553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.797994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.806950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.808818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.809394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.809850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a1ac29fcbcdc4bcfacfa2695a3bba6eb/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.810810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 306/607] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:06.811642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.828198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=a1ac29fcbcdc4bcfacfa2695a3bba6eb, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:06.830449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:06.849857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 302/608] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:06 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a1ac29fcbcdc4bcfacfa2695a3bba6eb/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:06.851060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:06.921932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7915-7d8f-46eb-b854-9feaf3299a96 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:06.966323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:06.967546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:06.968060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:06.968551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:06.993530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:07.002219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:07.009101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84e005-f2b0-4ec7-ae1c-30a2044e2292 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:07.023452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 307/609] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:07.025129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:07.058355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:07.061273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.061506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.061785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/2c8f234c44684cdfa836b64c3c87fc39/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.089844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=2c8f234c44684cdfa836b64c3c87fc39, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:07.094469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:07.115099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 303/610] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:06 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/2c8f234c44684cdfa836b64c3c87fc39/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:07.181403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc473a-d61b-4745-b74b-afe1fb22242f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:07.228474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:07.229200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.229487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.229764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.230566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:07.230980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:07.232411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:07.247555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 308/611] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:07.253276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:07.373521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d3466-0b21-4ee2-b88f-5d439c4ab859 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:07.415134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:07.416457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.416950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.417420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.431606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:07.433514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:07.455271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:07.456855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 304/612] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:07.462826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:07.614222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca788-72e7-48dc-a7c4-f851b5bca9d3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:07.663453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:07.664123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.664403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.664675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.665397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:07.665705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:07.667102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da1db-0403-4f08-a137-bb53d15f36d0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:07.681646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 309/613] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:07.687154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:07.822250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5539c4-906b-4fc6-b36d-c7aaaeaff9f5 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.822596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5539c4-906b-4fc6-b36d-c7aaaeaff9f5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.822869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5539c4-906b-4fc6-b36d-c7aaaeaff9f5 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.826749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 310/614] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:07.831968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.832259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.832537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.843423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c492-28a6-4c7a-b744-2b81eca5d774 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:07.875700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:07.876900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:07.877829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:07.878714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:07.879212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:07.879560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:07.888076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:07.890011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:07.904587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:07.906584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 305/615] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:07.913879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:07.998670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 311/616] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:08.018444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.097128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc162a16-41e5-4fb0-8401-a5e562a4175d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.162345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ee6d1-187b-4ed7-86ba-3a86f1b0df9d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.163829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.164789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.165266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.165743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.166811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:08.167303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.168945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.189252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 306/617] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:08.194568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.239016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.239849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.240133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.240409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.265520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:08.272870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:08.274288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 312/618] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:08.282041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.337852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbb9bf-ecb4-4086-93e5-6d2209b12748 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.372868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.373681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.373966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.374244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.385481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.386969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.405754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:08.407315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 307/619] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:08.412477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.466711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0743b75-247b-4512-8a34-b1747765cb45 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.508367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.509055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.509341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.509616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.510382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:08.512336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.513749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.531380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 313/620] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:08.537378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.592153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d966c2d-26fd-407c-8424-8fdce8376a2f None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.648308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.649157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.649266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.649534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.650269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:08.650576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.651985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.676004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 308/621] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:08.681255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.704654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0740-6f5a-40d7-a1bf-4af2e247f924 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.746167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.747414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.747912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.748385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.771754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.773224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.803169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:08.811042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dad021-692d-4efd-81e9-95573110f953 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:08.811316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 314/622] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:08.817618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.852172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:08.852968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:08.853253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:08.853533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:08.866299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:08.868950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:08.886465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:08.896352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 309/623] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:08.899077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:08.983149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ace783-734e-4497-a5b4-a6edbfdcd8c7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.030319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.031266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.031557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.031845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.032582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:09.032903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.034298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.053637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf4db-bd17-4b82-8069-76c51a73e180 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.057675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 315/624] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:09.063279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.087567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.088230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.088513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.088786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.089576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:09.089871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.091350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec6b8-bd8e-4722-8c44-29a157970dac None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.105727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 310/625] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:09.108650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9b90-ed98-4114-b56c-ce5b88e7542f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.108650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9b90-ed98-4114-b56c-ce5b88e7542f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.108650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9b90-ed98-4114-b56c-ce5b88e7542f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.109338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 311/626] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:09.114312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc9b90-ed98-4114-b56c-ce5b88e7542f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.176351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe2ede-963d-4a3b-9a44-3f3bb6a7ae42 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.213115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.214334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.214842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.215291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] PATH_INFO: `/v3/users/glance` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.223083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.224884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.235300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc9b90-ed98-4114-b56c-ce5b88e7542f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.239823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c77adf3b-bd5a-4b77-b583-d3783f8b119d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 01 09:51:09.241964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 316/627] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:09.243431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.243918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.244417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.262239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:09.263728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:09.268955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.269861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.270202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.270476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a3b5af1ed1a34c219c29b23c6ee49ce4/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.285141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=a3b5af1ed1a34c219c29b23c6ee49ce4, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.286599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.301846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 312/628] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:09 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a3b5af1ed1a34c219c29b23c6ee49ce4/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:09.303566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.338848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 317/629] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:09.390253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.427079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03c3b7-f4a0-4aba-b27f-8e34e24f9166 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.466473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.467223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.467671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.467940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.468793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:09.469113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.470591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.491179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 313/630] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:09.497373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.597096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9879e0-7738-4651-86ca-e3a422142fde None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.642084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.643258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.643715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.644161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.653323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded607-d0de-4648-9e5b-11d480f698fe None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.656943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:09.665698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-062841ef-277d-41f8-b996-f546e91a2650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:09.668217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 318/631] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:09.669776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251730-56b3-4386-b4a9-166473e90ed3 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.670233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251730-56b3-4386-b4a9-166473e90ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.670694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea251730-56b3-4386-b4a9-166473e90ed3 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.672789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 319/632] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:09.676087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea251730-56b3-4386-b4a9-166473e90ed3 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.695037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.695795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.696149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.696488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.767126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.768774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.809862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea251730-56b3-4386-b4a9-166473e90ed3 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:09.848943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:09.849632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.849979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.850324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.851174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:09.851547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:09.853000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d7dfa-1e5e-4822-aed6-ccb539006f46 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:09.865711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 320/633] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:09.867146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529632-a8c4-4a47-bed1-560960dc3467 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.867582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529632-a8c4-4a47-bed1-560960dc3467 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.867922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29529632-a8c4-4a47-bed1-560960dc3467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.882510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 314/634] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:09.883609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.884624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-29529632-a8c4-4a47-bed1-560960dc3467 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:09.885872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-29529632-a8c4-4a47-bed1-560960dc3467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:09.946976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 321/635] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:09.948473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-7534-4a29-8a2e-107a046ebacd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:09.948854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-7534-4a29-8a2e-107a046ebacd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:09.949196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181c78-7534-4a29-8a2e-107a046ebacd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:09.951085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 322/636] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:09.951756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181c78-7534-4a29-8a2e-107a046ebacd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:09.987642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f212b02-871f-4d2c-b7a2-be4b28fe168a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.019500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.020346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.020628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.020909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.030744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.032188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.048466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9d107831-c690-4a43-8aa9-49d317edf269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:10.049670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 315/637] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.050924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.051210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.051544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.063617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181c78-7534-4a29-8a2e-107a046ebacd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.067038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:10.068317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:10.097547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.098425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.098744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.099206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.111473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.114109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.142798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:10.142992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 316/638] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:10.142992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.143510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 323/639] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.143510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.239926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08e810-32f1-45d9-baa8-4fe90e5fcf8d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.241175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8fd3-c5b6-4466-977a-c723682189e4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.271857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.272538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.272824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.273102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.273827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:10.273941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.274132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.274733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.275019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.275294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.275536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.285727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:10.291658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 324/640] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:10.291658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.293290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:10.299093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 317/641] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.299093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.388811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab800-30a7-4ed5-ae63-e75f8a4031f8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.391307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b485e-cc7e-4872-ba58-88406fb41e59 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.422750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.423231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.423656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.424027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.424115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.424307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.424534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.424632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.425402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:10.425792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.427293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.434448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:10.441412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:10.447402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 318/642] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.447525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 325/643] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:10.447630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.447710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.545472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645ad9f-abf1-49f7-b62e-33ecb881d0ed None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.546674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096bbe-ac86-4f7d-a9b3-142e386799c7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.578199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.578611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.579199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.579448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.579536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.579852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.579947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.580250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.581072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:10.581449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.582992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.588813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.590460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.595581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 326/644] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:10.595581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.608104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:10.613721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 319/645] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.613721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.689833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d11d-42db-4ad5-8ab1-d997c8a9cb34 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.708268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209de163-05c7-47c9-9bb2-307dbe835731 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.720703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51b525-9c13-401d-946b-792276169797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.721579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51b525-9c13-401d-946b-792276169797 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.721934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51b525-9c13-401d-946b-792276169797 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.722215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa51b525-9c13-401d-946b-792276169797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.731106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51b525-9c13-401d-946b-792276169797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.732564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa51b525-9c13-401d-946b-792276169797 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.739416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.740197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.740571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.740934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.741769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:10.742192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.743692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.747097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-aa51b525-9c13-401d-946b-792276169797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:10.752986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 327/646] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.752986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51b525-9c13-401d-946b-792276169797 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.760734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 320/647] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:10.760734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.841948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa51b525-9c13-401d-946b-792276169797 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.860607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f29f6-1cbb-4c1c-ad37-cb810a6aec6b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:10.874627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.875467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.875750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.876212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.885622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.887096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.894307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:10.895050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:10.895344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:10.895637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:10.896457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:10.896754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:10.898158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:10.903821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:10.909806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 328/648] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:10.909806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:10.921452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 321/649] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:10.921452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.008475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802808a-de4f-4f8a-903c-2cdf3ccfe060 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.015964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d2c6-d721-4230-afd0-e5f1467c53d3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.041904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.042578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.043030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.043599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.044721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.044978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.046460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.048081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.048883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.049167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.049441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.059191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.060627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.065246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 329/650] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.066126 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.077059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:11.082743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 322/651] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:11.082743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.165044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829b91c-027c-4663-8818-0535033afa0e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.171568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fc9eb-740b-49eb-9186-3aeb4edf652a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.198409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.199447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.199735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.200014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.200739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.201045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.202431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.203728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.204558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.204983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.205260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.214042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 330/652] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.215290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.286588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.288019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.308254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7253-174e-4511-9ebb-b7bcc7f9c868 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.339547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.340219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.340506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.340791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.341939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=aba5e29ac89d4fd19a1c882830c2ef1e) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.342259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.343781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.358698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 331/653] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/role_assignments?user.id=aba5e29ac89d4fd19a1c882830c2ef1e&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.358698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.410696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 323/654] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:11.411717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.464313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a855fa-6fe0-48f8-a154-d3d0263ce83b None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.505862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.506716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.507095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.507463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.508292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.508690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.510317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.523695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 332/655] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.524713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.542350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e652dc8-d481-4cf6-b9ba-61c4eaa97a0b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.594562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.595578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.595861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.596137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.606251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.607750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.627768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 01 09:51:11.628995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 324/656] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:11.629880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.641969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cf445-fc10-4293-9fa9-71a3de3f3c81 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.692931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.694367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.694981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.695730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.706696 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.708476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.727320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:11.729164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 333/657] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:11.730027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.735982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7277860-7241-4904-acd4-8d596f9a67b2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.768127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.768931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.769217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.769495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.777073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.778517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.792290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-36e94baf-f87c-40ce-877b-429dc6970ae2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 325/658] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0669-68e6-4375-aca5-b699cee81bf3 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0669-68e6-4375-aca5-b699cee81bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a0669-68e6-4375-aca5-b699cee81bf3 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 326/659] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:11.797877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0669-68e6-4375-aca5-b699cee81bf3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.833831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0484a0-2231-4d7d-ba1a-976c9c1af93d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.867047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.867851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.868113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.868396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.869230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.869544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.870996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.892296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 334/660] 10.222.0.46 () {56 vars in 1137 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.892296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:11.905289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a0669-68e6-4375-aca5-b699cee81bf3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:11.937685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:11.938354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.938637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.938935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.939659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:11.939964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:11.941362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2adcd-4a2f-4882-a399-ef6af9deee53 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:11.955654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 327/661] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:11.955654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:11.955654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:11.955654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:11.969977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:11.971191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:11.990606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937eb9ac-1519-402f-bef7-19d433e25fd7 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.024327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.025001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.025289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.025566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.026398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:12.026740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.028163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.054741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 335/662] 10.222.0.46 () {56 vars in 1139 bytes} [Fri Apr 1 09:51:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:12.054741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.054949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 328/663] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:12.054949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.147865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171f9c7-bd24-4705-8df5-fb3533188da8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.152417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28a1aa-9dfa-48f3-a776-8a8aa348c983 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.181521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.182307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.182616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.182888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.187324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.187890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.188174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.188451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.189701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.191221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.204308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:12.210296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 329/664] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:12.210922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.253666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.255231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.305265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fd292-71c5-4550-ae9a-75334a0ea7cc None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.339737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.340392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.340674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.340960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.355765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 336/665] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:12.355765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.409808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.411376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.443780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e049b-ce91-4541-849b-d8f09e87df48 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.476566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.477406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.477690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.477965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.488014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:12.495080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:12.501062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 337/666] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:12.501062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.514340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 330/667] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:12.514340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.607883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7646-eebf-45e6-bb0f-dd6e3849cd8c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.608188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88966375-8d21-4930-856b-9eb19dbf83e3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.641137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.641723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.641834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.642074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.642351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.642512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.642828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.643106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.643192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:12.643472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.644998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.654818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.656507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.657236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 338/668] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:12.659552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.677715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:12.683609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 331/669] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:12.683609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.763654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578b86-59ee-43ec-bd9c-688c554e822d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.781582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7bc44-3555-4f2a-9cef-6a138b7cbeea None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.796371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.797038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.797327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.797607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.798355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:12.798683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.800103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.811983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 339/670] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:12.811983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.817941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.818849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.819197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.819540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.829792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.831291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.847002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:12.852746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 332/671] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:12.853374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.903798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e9f98-fba7-4615-90ac-cd98f6652855 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:12.938073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:12.938773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:12.939061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:12.939341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:12.940184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:12.940488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:12.941956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:12.947793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 340/672] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:12.948578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:12.973774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70d18-dc53-4a36-b796-af0724451547 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.023421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.025483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.025972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.026421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.027375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.027864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.029473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.052232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 333/673] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.053555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.067462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062b1b6-2cf6-433e-9772-2734d5aa40a5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.103229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.104302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.104424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.104662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.116558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.118062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.136130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:13.137768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 341/674] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:13.138580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.161045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724c74-a801-4e15-8b1a-a408f499e4e7 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.199877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.200662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.200843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.201124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.201851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.202159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.203984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.215695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 334/675] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.216806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.255650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649712b1-0eb0-498f-86e1-135c50678efa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.293695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.294629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.294994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.295357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.302232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.303778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.317687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:13.319340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 342/676] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:13.320065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.341772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd302c03-662f-4bae-9833-4a4032f14df0 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.384006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.385013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.385474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.386101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.387554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.388065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.390145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.407983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 335/677] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.409254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.427737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f708535-16f4-4bb7-8ad6-3272426a20b1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.470836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.471666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.471946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.472219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.483616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.485774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.503725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:13.505867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 343/678] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:13.507042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.540692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea335-35ea-48d4-aca9-05ce4e12ffbc None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.572757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.573379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.573660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.573930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.574743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.575050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.576484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.593897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 336/679] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.593897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.633715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d910f2-75ba-4542-bdb3-4080f4abb05c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.675478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.677140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.677641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.678428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.687968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7131150-22ba-4dfb-a07a-d5e1ffcd1f38 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.688621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.691221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.706831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:13.713061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 344/680] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:13.713926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.728520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.730024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.730510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.731247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.732408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.733231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.734925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.750824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 337/681] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.751934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.819640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c335-1d64-4aa7-bd58-23bf9e1338e4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.858050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.859273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.859760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.860232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.861306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a1ac29fcbcdc4bcfacfa2695a3bba6eb) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.861815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.863916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf80f-dfe3-4089-b9e0-c4066e6be5a6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.878676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f22061-21fa-414b-ad99-672d5043dd15 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:13.878868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 345/682] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/role_assignments?user.id=a1ac29fcbcdc4bcfacfa2695a3bba6eb&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.878868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebc9f3-6242-41c7-82b9-242ad89f251e None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.878868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebc9f3-6242-41c7-82b9-242ad89f251e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.878868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebc9f3-6242-41c7-82b9-242ad89f251e None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.881447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 346/683] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:13.881447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebc9f3-6242-41c7-82b9-242ad89f251e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:13.946760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:13.946760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.946760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.946760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:13.947120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:13.950673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:13.950673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9871aeb-a975-4ff4-8075-da697a8bdd75 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:13.993194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 338/684] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:13.994402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:13.994620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:13.994898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.032942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:14.034161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:14.080898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebc9f3-6242-41c7-82b9-242ad89f251e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.120928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 339/685] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:14.122132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:14.143730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.143730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.143730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.143730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.145148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=2c8f234c44684cdfa836b64c3c87fc39) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:14.145416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.149080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.157099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 347/686] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:13 2022] GET /identity/v3/role_assignments?user.id=2c8f234c44684cdfa836b64c3c87fc39&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:14.165935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:14.330312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3407-f318-43ff-ba3f-f84acf028113 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.397787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf4c6b-daf8-4346-9c4e-1a3ce5d5b5dd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.425927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.427032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.427551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.428031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.445956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.446823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.447105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.447519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.461986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.461986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.481240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:14.483130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 348/687] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:14.492023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:14.513840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.515346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.612687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f97a-2a74-4af5-bf6a-07828b8459d8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.617893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 340/688] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:14.627653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:14.650448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.651432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.651722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.651998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.652730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:14.653036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.654415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.668319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 349/689] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:14.673806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:14.778522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b41a8a-4f74-4903-b514-cfffd4b80661 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.815796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.816796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.817088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.817367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.818083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.819550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.842210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 350/690] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:51:14 2022] POST /identity/v3/users => generated 254 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:14.857773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627cdec-9298-468b-ae20-740c4fda2b99 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:14.916639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:14.917505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:14.917790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:14.918101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:14.929888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:14.931532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:14.950095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:14.951874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 341/691] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:14.957326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:15.077664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da316a-0547-4070-96c3-16c7c46803ff None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:15.112706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:15.113806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.114280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.114775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.115701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:15.116339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:15.117937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:15.132320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 351/692] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:15.142773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:15.261801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0181a-c109-4e05-8172-05371681bc55 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:15.300785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:15.301653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.301941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.302217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.313538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:15.315080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:15.331497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:15.333093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 342/693] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:15.338816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:15.436978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f314c-d68c-4960-9bbe-3aa8f172d2f3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:15.474208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:15.475704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.476192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.476650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.477632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:15.478121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:15.479785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877a6f-be29-456c-b39a-456c8fce2bd4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:15.497441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 352/694] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:15.503745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:15.627892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e90016-c468-455f-acf7-ab4aa52b8593 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:15.666275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16063279-831a-4076-870e-c3047c84c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:15.667017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063279-831a-4076-870e-c3047c84c279 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.667306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063279-831a-4076-870e-c3047c84c279 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.667584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063279-831a-4076-870e-c3047c84c279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.668420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16063279-831a-4076-870e-c3047c84c279 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a3b5af1ed1a34c219c29b23c6ee49ce4) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:15.668731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16063279-831a-4076-870e-c3047c84c279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:15.670171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16063279-831a-4076-870e-c3047c84c279 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:15.676301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 343/695] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:15 2022] GET /identity/v3/role_assignments?user.id=a3b5af1ed1a34c219c29b23c6ee49ce4&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:15.720682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf10c1-fe0a-47ff-8b2b-50ae7e1f1ab6 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.720992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf10c1-fe0a-47ff-8b2b-50ae7e1f1ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.721236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf10c1-fe0a-47ff-8b2b-50ae7e1f1ab6 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.727683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 353/696] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:15.733430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:15.733750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:15.733994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:15.759992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:15.761246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:15.861558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 344/697] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:15.890033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf10c1-fe0a-47ff-8b2b-50ae7e1f1ab6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.002371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf10c1-fe0a-47ff-8b2b-50ae7e1f1ab6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:16.036089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:16.036937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.037221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.037493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.047627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:16.054483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:16.056063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 354/698] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:16.061738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.162161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd2efb-c528-4c22-946a-2aef0f9ed324 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:16.199777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:16.200460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.200740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.201009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.201758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:16.202060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:16.203466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:16.212745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 345/699] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:16.218170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.325007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf86d8f-b5aa-4f99-a09b-33611ef99d12 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:16.370560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:16.371838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.372318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.372795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.384576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:16.386316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:16.407708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:16.409583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 355/700] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:16.415144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.554305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08490b-5301-4103-901a-6e308df33ed8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:16.594173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:16.594953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.595310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.595637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.596470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:16.596783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:16.598206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f110a7a-3fc2-468a-8a4e-ae1c0842e69e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:16.613646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 346/701] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:16.619066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.753348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52147d8-55bf-4063-88dc-268410166a2d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:16.808738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:16.809915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.810394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.810888 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.814413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c269c3-429d-4aa1-8a98-f112c9aeebca None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.814730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c269c3-429d-4aa1-8a98-f112c9aeebca None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.815013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c269c3-429d-4aa1-8a98-f112c9aeebca None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.816937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 347/702] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:16.822637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:16.822637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:16.822637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:16.827832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:16.829366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:16.840732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:16.842207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:16.855586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:16.857012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 356/703] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:16.862837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:16.914922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 348/704] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:51:16.939348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.050438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fe7a6-b295-4517-8a67-2cdf5cdc89cb None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.060603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4c3d-4b3a-4a9e-a8ec-11079d7818d5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.089244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.090062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.090340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.090611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.091300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.092669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.106961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 01 09:51:17.108793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 349/705] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:17.115562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.144520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.145261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.145546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.145876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.146770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:17.147081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.148576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.199427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 357/706] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:17.205372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.227956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47679c1a-0830-439d-8aa1-d760c0aae391 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.260330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.260998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.261278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.261549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.262253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:17.262556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.263948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.268790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 350/707] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:17.274263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.322939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90419f3-8a9e-412d-a01c-868f35f73e82 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.356022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.356914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.357336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.357748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.377577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cfe5e-31be-4b7c-a202-030df5b44190 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.410786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.411722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.412139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.412562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.413408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:17.413846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.415399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed796f-d7bf-4df0-8469-d6b661d005a6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.424554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.426458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14087443-7d90-43b3-90a9-4869df18affb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.426773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 351/708] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:17.428361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fe77-1cb7-4f62-b034-8101a7e60bda None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.428653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fe77-1cb7-4f62-b034-8101a7e60bda None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.428925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fe77-1cb7-4f62-b034-8101a7e60bda None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.431005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 352/709] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:17.436700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eae4b-6494-43eb-8f25-96a3ed92211b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.436700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eae4b-6494-43eb-8f25-96a3ed92211b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.436937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202eae4b-6494-43eb-8f25-96a3ed92211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.468788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-202eae4b-6494-43eb-8f25-96a3ed92211b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:17.469979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-202eae4b-6494-43eb-8f25-96a3ed92211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:17.538542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 358/710] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 01 09:51:17.540424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a1a2-f4ef-4dfe-a765-dca1cdcbd45c None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.540915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a1a2-f4ef-4dfe-a765-dca1cdcbd45c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.541384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128a1a2-f4ef-4dfe-a765-dca1cdcbd45c None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.543957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 359/711] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:17.545068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128a1a2-f4ef-4dfe-a765-dca1cdcbd45c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.571629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 353/712] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:17.573091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.573326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.573607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.591508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:17.592527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:17.654971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128a1a2-f4ef-4dfe-a765-dca1cdcbd45c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.662045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 354/713] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:17.667066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.698407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.699330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.699613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.699887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.712201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.713372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.733907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:17.738819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 360/714] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:17.739764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.801263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc890b2-f6ed-4d70-b15a-0c0f3ad3faf4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.836940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2e30-8265-4e45-9740-ffe514021c13 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.845455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.846628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.847074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.847478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] PATH_INFO: `/v3/services/network` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.848383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:17.849874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:17.861007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 01 09:51:17.862676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 355/715] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:17.863605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.872382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:17.873319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:17.873747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:17.874135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:17.884543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:17.891941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:17.893479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 361/716] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:17.894441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:17.966694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c32a-3653-475e-9e04-6e0972fedb57 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:17.996545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70be1c5-b5fa-4373-92ee-f6cf47237fe2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.002426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.003127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.003412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.003693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.004468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.005184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.006954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.022170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 356/717] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.023024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.040766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.041710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.042125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.042849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.043899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] RBAC: Adding query filter params (name=network) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.044276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.046252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.054726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 362/718] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.055570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.150017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c3569-3387-47f7-896f-3d1ec75b7b6e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.151818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464ee67-40b5-4383-b92b-95679c634d0a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.186323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.187174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.187460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.187819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.191389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.192172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.192521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.192866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.193699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.194075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.195209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.195739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.196819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.204953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 357/719] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.205795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.211554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:18.217451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 363/720] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:18.218410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.318140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e221e-598d-49fa-9b0f-a78def729d9e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.329637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576ff2-b1d5-4b6d-87c4-4dbfe9fdc847 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.351795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.352816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.353097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.353371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.365263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.366930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.370637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.371375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.371661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.371941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.372667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] RBAC: Adding query filter params (type=network) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.372978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.374403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.386275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:18.387089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 358/721] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.388012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 364/722] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:18.388129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.395231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.569724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44fb67-6716-4fb7-b643-fa4d4d8aff05 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.603998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ac44-ce58-410a-94a0-067f200eec27 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.618887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.619911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.620412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.620908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.622037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.622536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.624197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.645045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 359/723] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.646776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.651498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.652177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.652466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.652747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.653479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.653788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.655518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.668189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 365/724] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.673947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.765755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f34c8-aaf1-4196-864c-8b980cf2cdb3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.784133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e29fd-d483-4d38-858d-b00b7d0af308 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:18.798829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.799495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.799780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.800059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.800907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:18.801253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.802708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d1f07-a7ed-4e2e-92c7-70bf0567c11e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.808486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 360/725] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:18.809775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5785fb-28f4-4206-8d46-b02c6d64b1f8 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.810062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5785fb-28f4-4206-8d46-b02c6d64b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.810339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5785fb-28f4-4206-8d46-b02c6d64b1f8 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.812264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 361/726] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:18.818573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.818885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.819260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.827665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:18.830216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:18.831209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:18.833308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:18.851570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:18.851570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:18.852962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:18.854391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:18.886732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:18.891335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 366/727] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:18.916067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:18.963948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 362/728] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:19.013735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.069522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eaf9a1-726f-4716-b7a8-333d389e7e82 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.122064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.122764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.123071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.123483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.124146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:19.124449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.125875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.138788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65982b1a-495a-4235-8bc5-2eb4a6f85a1d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.159721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 367/729] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:19.167338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.185310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.186054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.186344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.186627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.211586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:19.218571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:19.227158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 363/730] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:19.232627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.267648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d7650-3c71-4215-b696-31505aae68df None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.315366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.316384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.316907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.317366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.365940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9f825-09a3-495d-8a53-f63e8480941b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.421745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.423595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.426018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.426718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.427167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.427593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.428468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:19.428900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.430390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.449857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 364/731] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:19.456384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.568408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 368/732] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:19.573822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.623049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e679b-0d44-4c78-8d12-735b122ed897 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.659550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.660738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.661214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.661682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.681260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.685950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.711115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:19.716956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 365/733] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:19.719626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.754642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c15653-6477-4209-9d4d-1b7d4b236392 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.827277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.828485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.828955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.829434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.844397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.846263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.875120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:19.882398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 369/734] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:19.885639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ba128-578d-4d31-b440-6827dcf9f9cf None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:19.887384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:19.920195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:19.921211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:19.921701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:19.922181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:19.923173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:19.923692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:19.925290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:19.937839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 366/735] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:19.943472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.042236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c116f2b-084b-4819-9b3e-0e5c44029b57 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.077563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.078767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.079239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.079698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.087264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.088947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.102829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:20.104616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 367/736] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:20.110271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.126508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73646d8b-1e32-463d-a55b-c3b26be03685 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.219965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.221225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.221911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.222330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.223464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:20.223930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.226005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dca222-4a21-4847-b223-f075f19acbb2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.227133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0502dd4-1ba6-40e6-ad05-83343e281549 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.239975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 370/737] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:20.241652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73580ab-0b06-4f1a-8bb7-fa496cff1fcd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.242176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73580ab-0b06-4f1a-8bb7-fa496cff1fcd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.242636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73580ab-0b06-4f1a-8bb7-fa496cff1fcd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.244772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 371/738] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:20.245678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73580ab-0b06-4f1a-8bb7-fa496cff1fcd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.268613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.269291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.269702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.270135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.271143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:20.271581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.273233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23263376-e41e-44d8-9043-e2f4b5549a4b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.291764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 368/739] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:20.293244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.293745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.294144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.312031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:20.313455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:20.349113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73580ab-0b06-4f1a-8bb7-fa496cff1fcd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.382796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 369/740] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 01 09:51:20.384480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.392273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.393353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.393824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.394282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.407951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.409393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.422550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:20.423978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 372/741] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:20.424570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.511185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64684614-20ec-4dd3-bb82-2a90a4f48e30 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.523818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb14068-e48b-4d56-a60c-adc07725b192 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.553334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.554559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.555130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.555687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.557870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.558639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.559042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.559365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.560926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.561640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.590672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 373/742] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:20 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:20.590672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.695204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.696841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.822526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe5d9e-f103-47c6-8551-29abba3728f2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:20.861858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:20.862540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:20.862874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:20.863160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:20.863989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:20.864509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:20.865755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:20.868750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 370/743] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 01 09:51:20.875606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.880467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 374/744] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:20.887372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:20.985170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd296af-6a90-4b56-b171-86ebcfa552f5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.012057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860eec-1496-4601-973e-5e5ede52a23c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.030539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.031384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.031665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.031938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.041998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.043492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.047538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.048424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.048874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.049315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.050330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=943154c0b9094ad79191f37028e30f73) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:21.050973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.052579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded17da-917a-42c0-86fa-83b22545d541 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.058871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 375/745] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/role_assignments?user.id=943154c0b9094ad79191f37028e30f73&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:21.066679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cb16-05bf-4fde-882f-ea958c7d05b5 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.066892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:21.067041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 371/746] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:21.067726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cb16-05bf-4fde-882f-ea958c7d05b5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.068191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7cb16-05bf-4fde-882f-ea958c7d05b5 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.068557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.070731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 376/747] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:21.078667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.079255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.079698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.119215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:21.120692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:21.238826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da02b1-bc03-4e12-9d2c-82e910b54c2c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.246349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 377/748] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 01 09:51:21.274372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.312099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.313230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.313518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.314049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.314833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:21.315299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.317310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c8dc2-6701-4eea-9f6b-337fd3f72bb2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.330580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 372/749] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:21.336646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800a65-9826-4e13-bcab-f3930fa0c928 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.336942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800a65-9826-4e13-bcab-f3930fa0c928 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.337221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a800a65-9826-4e13-bcab-f3930fa0c928 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.339428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 373/750] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:21.340402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800a65-9826-4e13-bcab-f3930fa0c928 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.401828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eccac1-4477-4237-8c27-0df3de1a8208 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.434606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.435645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.436149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.436607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.437495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.439247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28177848-5e5d-4f92-928d-9ab81b784207 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.462857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 378/751] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:21 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:21.466135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.466135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.466135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.477234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a800a65-9826-4e13-bcab-f3930fa0c928 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.505955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:21.507318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:21.546918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.547795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.548088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.549217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.562682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.565144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.592482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:21.595823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 374/752] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:21.607306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.641480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 379/753] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:21.664399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.750700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaf1a2-03ce-4bfa-b8b1-a04b0197ea1e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.763704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2afd8e-e5f4-497a-a107-2ad1a8e88a04 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.790301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.790999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.791281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.791553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.792334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:21.792640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:21.794072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:21.798841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:21.799656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:21.799936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:21.800209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:21.808490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 375/754] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:21.813722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.815960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:21.823270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:21.824784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 380/755] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:21.831421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:21.982499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc5cbf-5517-4e3c-84e3-37ff6c8b5ed2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:21.996593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22552-9298-492a-a381-7ed917ec6223 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:22.042508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.043118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.043400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.043670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.044503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a3b5af1ed1a34c219c29b23c6ee49ce4) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:22.044810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.046245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.054016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 376/756] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/role_assignments?user.id=a3b5af1ed1a34c219c29b23c6ee49ce4&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:22.055041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.055781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.056058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.056327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.057132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:22.057435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.058838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.068365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 381/757] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:22.079908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:22.222721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194aa18-f6d8-45b6-884d-479205835ea2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:22.266214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.267065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.267421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.267699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.279958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.281801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.305254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:22.306443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 377/758] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:22.312611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:22.430636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d9fb-6dcd-46ae-b4cb-67934b969e51 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:22.482334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.483041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.483322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.483592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.484323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:22.484624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.485997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.507218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 382/759] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:22.512681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:22.635388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d24e7-4cf9-4808-bb15-8a59706e22ce None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:22.679364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.680189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.680470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.680743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.688256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.689705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.704298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:22.705802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 378/760] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:22.711640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:22.891698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4cc92-382a-403a-a201-6d35a0959faa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:22.943365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:22.944053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:22.944336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:22.944612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:22.945458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:22.945767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:22.947253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:22.970167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 383/761] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:22.975687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:23.117948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29891519-9a98-4169-854c-58bdd1be114b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:23.165349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:23.166115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.166393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.166677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.182674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:23.184205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:23.204533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:23.206092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 379/762] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:23.211459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:23.353342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1273ab-b560-41f5-8a91-19fcf481974e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:23.403366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:23.404049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.404318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.404604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.405654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:23.405964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:23.407375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:23.419723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 384/763] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:23.425200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:23.546955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa184c-14d9-433a-b632-3a6c098f1f87 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:23.586457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:23.587374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.587663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.587944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.596011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:23.597541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:23.616830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-a27b836e-d058-4a36-89cd-829346bbec2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:23.618513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 380/764] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:23.624346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:23.682984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e44a3-1f00-4e49-b21e-4850575ac66f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.683292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e44a3-1f00-4e49-b21e-4850575ac66f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.683467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e44a3-1f00-4e49-b21e-4850575ac66f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.685244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 381/765] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:23.690357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.690641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.690947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.714739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:23.716121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:23.787487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c105b-5590-446f-8d2e-778c8207df24 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:23.834795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 382/766] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:23.848247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:23.848937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:23.849220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:23.849499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:23.850324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:23.850632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:23.852098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:23.865144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 385/767] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:23.871407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:23.879105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.012578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96220-fc7c-495f-923c-296f8bb52694 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.026445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e06f3e-927c-4aae-896d-a988b3f1f40e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.051602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.052765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.053047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.053319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.056066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=e04e4b6a2827449dbe36886a303f7a10, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.058000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abab3aa-d34b-496a-8fa4-bb856e1e1438 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.065836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.066980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.067439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.067790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.068522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.069968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.075527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 383/768] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:23 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:24.077068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2b1b2-7574-4a15-a92d-4f7bb5feff95 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.077562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2b1b2-7574-4a15-a92d-4f7bb5feff95 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.078045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2b1b2-7574-4a15-a92d-4f7bb5feff95 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.084615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 01 09:51:24.084809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 384/769] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:24.086515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.087064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.087518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.090861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 386/770] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Apr 1 09:51:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:24.092648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.108210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:24.110503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:24.197381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 385/771] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:24.202689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8bf13-e070-4cf9-b99e-8aea85fc54cc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.220632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.239942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.241044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.241479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.241916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.242833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:24.243274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.244790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.254521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 387/772] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:24.256129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.326476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346ba0-6bb2-4f13-a0fd-cfe68fc766dd None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.363594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.364281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.364653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.365023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.366201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71065cd3-8463-490c-a115-be48b0509433 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.377388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:24.384522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-dc4ce140-057e-4240-a089-df6e7184483c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:24.386236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 386/773] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:24.388399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704010-d2b1-4fb0-8437-b8f2ad84da53 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.388694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704010-d2b1-4fb0-8437-b8f2ad84da53 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.388983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704010-d2b1-4fb0-8437-b8f2ad84da53 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.390737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 387/774] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:24.395319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704010-d2b1-4fb0-8437-b8f2ad84da53 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.407830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.408878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.409162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.409440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.410226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:24.410543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.411993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94002d13-9b3e-460b-baf5-078b9f237ff5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.420088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 388/775] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:24.421616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.422046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.422462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.440644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:24.442121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:24.514526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704010-d2b1-4fb0-8437-b8f2ad84da53 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.523042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 389/776] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:24.523694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.560899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.561679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.561861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.562140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.562985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:24.563211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.564605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.573803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 388/777] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:24.574054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.647659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b4180-7e50-4705-9c6e-3cd6a6794135 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.681052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.681852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.682032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.682285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.683106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] RBAC: Adding query filter params (interface=public, service_id=f811f833d09c4f99afc9dd5b7c4acaef, region_id=RegionOne) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:24.683433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.684767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.696859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 390/778] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/endpoints?service_id=f811f833d09c4f99afc9dd5b7c4acaef&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:24.696859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.706145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691d277-9454-4d1c-8b90-6228327f7ada None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.738198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.739031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.739311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.739583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] PATH_INFO: `/v3/services/network` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.740230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.741595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.752411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 01 09:51:24.753633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 389/779] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:24.754473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.799439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bcd54-789b-4e6f-bb5e-278af3d14045 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.832374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.833181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.833467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.833743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.844847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.846534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.860236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88400eb9-e84b-48a9-b4fc-a5408693cf01 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:24.862936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a7523684-5f45-40a2-8f6e-fa0af40e8796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 391/780] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649885ea-495a-4848-b343-6a6068f1f0b7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649885ea-495a-4848-b343-6a6068f1f0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649885ea-495a-4848-b343-6a6068f1f0b7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 392/781] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:24.868766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649885ea-495a-4848-b343-6a6068f1f0b7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:24.900708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:24.901700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:24.902274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:24.902851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:24.904439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:24.906275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:24.913131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 390/782] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:24.914046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.000138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649885ea-495a-4848-b343-6a6068f1f0b7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.026137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575f359-b025-40cc-902d-c0392aa8fabe None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.054566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.055544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.055829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.056111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.057010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] RBAC: Adding query filter params (name=network) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.057663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.059554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927f0d2-c18a-497f-874b-d93160a29d7c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.068339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.069183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.069531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.069873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.070540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 393/783] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.070858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.071230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.072174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.072469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.072748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.072857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.088261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 391/784] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.089305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.098620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:25.100500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:25.187880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 394/785] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:25.194673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.221584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c245-57c6-4e24-b798-99343bc9bbb8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.256496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.257155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.257433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.257702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.258398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] RBAC: Adding query filter params (type=network) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.258737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.260172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.265503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 392/786] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.266759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.309527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca8d1e-c206-4324-869d-5e05b5ed0d9b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.344113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.345097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.345378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.345652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.353301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.354811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.370908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:25.372526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 395/787] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:25.373369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.386396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc06e-90c4-4043-bff0-6568b334ed43 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.429979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.431477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.431978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.432465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.446379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:25.455318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:25.457539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 393/788] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:25.458892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.494515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d2ca8-6b11-4461-a3d0-f54e9f5091bf None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.526895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.527778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.527967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.528406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.529257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] RBAC: Adding query filter params (interface=public, service_id=9b1cf7ff61a44d2c8c2bef74d6f81762, region_id=RegionOne) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.529627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.531479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.537003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 396/789] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/endpoints?service_id=9b1cf7ff61a44d2c8c2bef74d6f81762&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.537966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.575770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848cb36-89fd-40cf-8054-baba07125ee4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.614877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.615826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.616304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.616744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.617736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.618208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.619849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.637310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 394/790] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.638416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.649693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28d08e-65ee-42e2-815c-70a2369969a9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.691141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.692028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.692312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.692586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.693678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:25.694225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.695836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.705181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 397/791] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.706258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.746949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e68e41-4dbe-4071-a814-1cd825af718d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.791764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.792444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.792733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.793000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.793686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.795104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.807087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 395/792] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:25.808077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:25.817615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34b6fa-0154-42a2-a72f-8bf24f1fa38c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:25.852679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:25.853957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:25.854466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:25.854979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:25.867052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:25.868880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:25.887179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:25.893567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 398/793] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:25.895321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.001220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1f29a-08fb-48e5-a57c-49e2550de841 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.001654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2b325-b9fa-448e-b03f-713333e0a651 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.038498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.039692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.040185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.040663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.041608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:26.042152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.043885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.061617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 399/794] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:26.063634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.069910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.070992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.071383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.071669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.087689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.089189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.113387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:26.115190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 396/795] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:26.120317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.172748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ee1e-0f38-46b1-9d9f-21833e7b81b3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.206701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.207868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.208365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.208812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.216050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.217726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.224527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9802-3798-4b29-a32c-17a3bc8a7975 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.231642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:26.238167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 400/796] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:26.239772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.261524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.262047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.262421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.262801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.263602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:26.263985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.265616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.278314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 397/797] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:26.287797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.346758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89845b-10e6-4a64-9e57-61d2483eb9de None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.380298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.381297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.381786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.382231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.383264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:26.383785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.385435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.402925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 401/798] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:26.404938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.503691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bee1ed-2d8b-4aea-bcbb-182b6185f20f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.538162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.539470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.539973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.540419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/943154c0b9094ad79191f37028e30f73/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.554228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafc2d-4096-44c7-bd20-082dcccba6ec None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.556659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=943154c0b9094ad79191f37028e30f73, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.558314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.581082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 402/799] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:26 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/943154c0b9094ad79191f37028e30f73/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:51:26.602523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.603830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.604329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.604799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] PATH_INFO: `/v3/users/swift` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.614881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.616649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.631807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-fb0c71ac-d358-461d-b33c-0ba169a1974a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:26.633813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 398/800] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:26.639633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.664236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08cfa-d504-4d84-8499-69b7efada02f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.664236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08cfa-d504-4d84-8499-69b7efada02f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.664523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a08cfa-d504-4d84-8499-69b7efada02f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.670709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 399/801] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:26.685721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.686008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.686279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.717062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:26.718334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:26.822784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701eb43-3e47-4d29-8155-a6f6b142b87d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:26.855107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:26.855795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:26.856070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:26.856339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:26.857170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:26.857476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:26.859024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:26.868409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 400/802] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Apr 01 09:51:26.882042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 403/803] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:26.887406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:26.904480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.004923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3b36-9e04-4bca-b7e4-fb6a08b54968 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.043805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.045017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.045532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.046000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.057776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.059731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.083447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:27.085662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 401/804] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:27.095641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.098949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96f119-c698-4caa-affe-37246d253851 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.170977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.172211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.173630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.174108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.194842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:27.204850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:27.211212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 404/805] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:27.216898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.268774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6168f6-2396-4151-b922-339e20058bb5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.305936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.307034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.307815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.308312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.309279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:27.309778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.311827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.324941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 402/806] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:27.330564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.394978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a1632-ec69-4a09-ac07-dc9341007241 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.428583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.429502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.429931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.430374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.431310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:27.431758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.433292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.442289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 405/807] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:27.447622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.528993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeae4a-a5ca-4db6-9692-12017b50f87a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.583007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.583821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.584102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.584375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.587093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a5818-97b8-45a3-9291-3f701a80c3ad None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.591049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.592490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.606363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8ce7e8d9-3bca-4038-84fe-c848179bd33b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:27.607958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 403/808] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:27.609302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37460ac-819a-4d86-a455-69400f6521e6 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.609586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37460ac-819a-4d86-a455-69400f6521e6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.609864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37460ac-819a-4d86-a455-69400f6521e6 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.615818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 404/809] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:27.617087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37460ac-819a-4d86-a455-69400f6521e6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.619732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.620559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.620841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.621114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.631758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.633211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.649466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-b04e5131-bd7c-403e-bd82-74ce5510cfb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:27.650915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 406/810] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:27.652167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.652449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.652720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.669868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:27.671066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:27.716416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37460ac-819a-4d86-a455-69400f6521e6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.742936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 407/811] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:27.743868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.749260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.749933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.750215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.750487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.751297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:27.751604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.753039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.765307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 405/812] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:27.771203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.858557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f108-ea77-47f0-b3cf-724ce6e40493 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.891475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.892195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.892478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.892757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.893476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:27.893778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.893962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3d502-c86a-4f15-b3e4-5ed8e32dba72 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:27.895273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.912541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 408/813] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:27.913513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:27.934526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:27.935982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:27.936599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:27.936877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a3b5af1ed1a34c219c29b23c6ee49ce4/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:27.939594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=a3b5af1ed1a34c219c29b23c6ee49ce4, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:27.941805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:27.959418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 406/814] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:27 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/a3b5af1ed1a34c219c29b23c6ee49ce4/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:51:27.960315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.059293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820995ba-9185-4240-a563-3762d35879a3 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.075408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a78f1-e5e8-4637-a275-3f6ded91d1f2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.113056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.113882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.114162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.114435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.115091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.115483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.116043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.116412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.116589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.116854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.125772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.127638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.128096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 01 09:51:28.129653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 409/815] 10.222.0.46 () {56 vars in 1129 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:28.135833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.143885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:28.146071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 407/816] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:28.152958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.253132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91eeea-01bb-4411-9e66-83e69613730e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.297849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.298952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.299436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.299924 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.300863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:28.301375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.302979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.308382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 410/817] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:28.314833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.325513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb1677-caf8-4ead-b442-7c740d55cec2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.361482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.362526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.363091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.363590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.364619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:28.365104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.366761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.385410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 408/818] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:28.390822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.438623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705adee-369f-4d86-827e-2cc17f82a1f8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.473154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.474234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.474746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.475253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.476159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:28.476660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.478244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.483930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 411/819] 10.222.0.46 () {56 vars in 1124 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:28.493857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.592027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b236a5-5f82-4182-b33f-94a636a90d57 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.655565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933a3-2877-4cf2-9239-99aee1d45891 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:28.671519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.672452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.672864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.673272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.691838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:28.692656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.693040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.693418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.694224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.695803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e799f-98ac-4fdf-b4c0-58752a71e4f6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.719429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 412/820] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:28.721207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5841-7c85-44e0-9a8a-0419ad3d4490 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.721684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5841-7c85-44e0-9a8a-0419ad3d4490 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.722209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e5841-7c85-44e0-9a8a-0419ad3d4490 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.724598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 413/821] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:28.736386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:28.737004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:28.737429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:28.767575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:28.767977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:28.768881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:28.769975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:28.879178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 409/822] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:51:28.888817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:28.940772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 414/823] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:28.966426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.046863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01e53a-61c8-41e6-b71b-142fd3dfff88 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.084649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be9436-ca0b-460d-8c6c-4086e25b1d23 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.089189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.090211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.090714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.091194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.112377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.115176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.139314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.140721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.141205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.141653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] PATH_INFO: `/v3/services/network` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.141810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:29.142631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.143514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 410/824] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:29.144543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.153310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.174673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 01 09:51:29.176704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 415/825] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:28 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:29.182194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.287647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10fb87-41de-40d8-858e-7b95807ab7db None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.322331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10be481-b519-4b23-841c-6c268aac6892 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.326745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.327524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.327901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.328234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.329079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:29.329456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.331028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3aa6e-548d-41be-937d-4cde81ef866a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.344059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 411/826] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:29.350066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ba2f-652d-40c4-9835-4fc5b23569b6 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.350429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ba2f-652d-40c4-9835-4fc5b23569b6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.350810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ba2f-652d-40c4-9835-4fc5b23569b6 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.356679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 412/827] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:29.356679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437ba2f-652d-40c4-9835-4fc5b23569b6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.370768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.372056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.372543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.373133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.374460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] RBAC: Adding query filter params (name=network) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:29.375243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.377261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a238fcb-f9b5-4b77-ab5c-b8370f36cc8e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.383521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 416/828] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:29.385037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.385454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.385883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.405687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:29.407264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:29.478673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 417/829] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:29.478673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.491044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437ba2f-652d-40c4-9835-4fc5b23569b6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.537252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.538850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.539367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.539859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.549067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.551389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.567868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:29.570198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 413/830] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:29.571310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.592584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea041750-edfd-488b-a1c9-ce8f382a8122 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.634628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.635865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.636484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.637267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.638426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] RBAC: Adding query filter params (type=network) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:29.638946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.641239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.648476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 418/831] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:29.649472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.690865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e334-a68d-49ab-8ebb-152e016cbfe9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.738672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.738672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.738672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.738672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.749350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:29.751326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672b065-6974-4dd4-9215-0a5e6d6acf04 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.757610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:51:29.759620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 414/832] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:29.760526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.787731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.788575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.788955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.789323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.790206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:29.790659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.792240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.808373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 419/833] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:29.809312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.868017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7546f-cfef-4311-9643-cc1db9cb3266 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:29.901088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:29.901779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:29.902063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:29.902341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:29.903152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:29.904619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:29.930118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 415/834] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:29.932139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:29.945400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dfb4-dde8-4ee1-9472-ec1679a2603a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.023322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.024008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.024297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.024569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.025389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:30.025700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.027420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.042994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 420/835] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:30.048624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.154618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe044a72-9e47-44f9-b711-f2d0b08209f3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.192164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e833411-4fc2-4dd0-afc8-0f49d8ead736 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.196651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.197603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.198084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.198571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.199720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:30.200227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.201882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.209457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 416/836] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:29 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:30.255169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.256027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.256283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.256558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.272366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.273845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.297523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:30.301548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 421/837] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:30.305021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.424076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42211f-6bad-4634-9388-50c43fc33871 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.462836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.463466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.467102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.467102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.467102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:30.467102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.467102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24665e5-915a-48de-81f4-0758d6695545 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.481380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 417/838] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:30.487179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.542098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d7b-cec1-49c0-9fbc-9df2a6004c14 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.542460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d7b-cec1-49c0-9fbc-9df2a6004c14 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.542694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f0d7b-cec1-49c0-9fbc-9df2a6004c14 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.545405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 418/839] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:30.549942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.550226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.550538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.568498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:30.570011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:30.611154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed5217-0d4f-4d59-9dcc-525b6d615182 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.645623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.645854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 419/840] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:30.654743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.654743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.654743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.658569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.660231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.670433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.679588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:30.682056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 422/841] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:30.689757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.770425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90df80-d693-4dc0-b072-fb6190ca6653 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.783297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146494a5-d022-49f4-8b45-5736e533f505 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.804018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.804825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.805111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.805389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.815992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:30.817619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.818461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.818914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.819357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.820319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:30.820765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.822318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.823037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:51:30.824609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 420/842] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:30.830294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.850948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 423/843] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:30.853367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.939220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504984f-446b-4528-ae0a-f37b7ee2b42b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.961583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465117-5ed9-421c-ab98-4a470afa4b2f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:30.978214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.979007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.979296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:30.979570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:30.980546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:30.980857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:30.982374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:30.996111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 421/844] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:30.997158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:30.998523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:30.999414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:30.999883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.000341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.067771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.069608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.097845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae27654-08d3-455e-8214-315caecbc1b6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.131641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.132375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.132655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.132935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.144143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.145681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.164272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:31.170554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 422/845] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:31.171427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.184478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 424/846] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 01 09:51:31.185980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.272369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e644-22c1-46b5-b34e-58618a785a12 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.304721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d691d-6fe4-42bc-9913-58e3fba92546 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.310947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.311617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.311895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.312166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.312884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:31.313390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.315163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc1495-c43c-41ad-8ff9-39f8cf1d523b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.330939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 423/847] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:31.332583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12c778-0d2c-42a4-95be-22bbba2f994b None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.332867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12c778-0d2c-42a4-95be-22bbba2f994b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.333137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12c778-0d2c-42a4-95be-22bbba2f994b None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.338824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 424/848] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:31.338824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12c778-0d2c-42a4-95be-22bbba2f994b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.340985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.341783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.342069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.342746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.352723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.354166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.370847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-31df0fb2-863b-4a11-83d7-0746574e236f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:31.376613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 425/849] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:31.377884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.378174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.378495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.394577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:31.395768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:31.436705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12c778-0d2c-42a4-95be-22bbba2f994b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.467219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 426/850] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:31.467219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.477280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.478087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.478368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.478668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.486451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.487969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.501497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 01 09:51:31.507345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 425/851] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:31.507345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.579752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeecac-3c4e-47cf-9adb-355af03803bb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.600880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1363ee-0b46-44f2-98a0-c3d4837e1d40 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.613706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.614375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.614680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.614991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.615679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:31.615980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.617342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.632641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 427/852] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:31.632641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.638899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.639706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.639985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.640255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.640916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.642308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.653302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 01 09:51:31.659466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 426/853] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:31.659466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.732180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d963288-bf9f-44dd-bc27-89f16c0fb65a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.747617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924f2a-661d-4ef7-88a8-4bf31262b192 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.763664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.764340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.764621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.764894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.765728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:31.766042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.767541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.779347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.780472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.780750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.781020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.789635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 428/854] 10.222.0.46 () {56 vars in 1135 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:31.789635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.789846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.789846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.803179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:31.805120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 427/855] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:31.805478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.884751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c7ff-ddf0-4d1e-8c9a-45e905fdc687 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.911361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156ee9-7fc1-4b43-9d34-55131db7402b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:31.917869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.918729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.919146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.919555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:31.920412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:31.920849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:31.922373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:31.931065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 429/856] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:31.931905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:31.945375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:31.946023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:31.946300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:31.946573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.010729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.012213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.025279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a9fc0-b80e-4444-9915-35e4f65a830a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.058439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.059116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.059398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.059672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.060450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:32.060756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.062176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.078266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 430/857] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:32.078266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.116986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 428/858] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:51:32.116986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.169351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cb2a5-2596-454a-80ef-7238d90a79ca None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.203259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.203953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.204232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.204506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.205227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:32.205528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.206966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.222693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 431/859] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:32.222911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405026c-4c3b-49d4-8162-d37df369008f None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.223348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.262662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.263473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.263825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.264165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.265085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=943154c0b9094ad79191f37028e30f73) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:32.265464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.267172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.274209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 429/860] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/role_assignments?user.id=943154c0b9094ad79191f37028e30f73&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:32.349796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c23dc4-ae59-4a1b-a37d-bffbb7156917 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.388575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.389421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.389704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.389977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.403034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.404537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.423356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:32.424908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 432/861] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:32.431169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.553226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b173a-ae18-4d2c-a971-f54cdcb46bcc None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.593434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.594101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.594381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.594677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.595404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:32.595704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.597467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c5f24-7dc5-4ec3-af15-53a13ab22a1b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.609332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 430/862] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:32.615027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.624749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d68bc-aa06-47de-b986-0af9d7457976 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.625032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d68bc-aa06-47de-b986-0af9d7457976 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.625827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d68bc-aa06-47de-b986-0af9d7457976 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.628377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 431/863] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:32.633956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.634241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.634524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.659439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:32.660760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:32.725992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 432/864] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:32.728053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57ca33-8195-4fbf-b465-7b6a81ce70db None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.747873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.771185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.772625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.773104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.773675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.783526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.786248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.803991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:32.809839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 433/865] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:32.811503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.857862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971cabf-d544-4b87-b09a-675c54d9a385 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.892577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.893526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.893875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.894275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.895202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.896499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.908286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 01 09:51:32.914750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 433/866] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:32.916637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:32.949546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb80-4d6c-4fa2-9069-9823400584f5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:32.984415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:32.984819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:32.985108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:32.985388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:32.986180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:32.986509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:32.987999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:32.999650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 434/867] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:33.006543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:33.043550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c69dc7-5855-4b5e-923e-cdd3100986c5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:33.080952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:33.081689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:33.081973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:33.082239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:33.082983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:33.083691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:33.084672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:33.097683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 434/868] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:33.099040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:33.124602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efc9cf-f155-4e8d-a9e1-a3feaceb8007 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:33.158947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:33.159615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:33.159939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:33.160225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:33.161058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=a3b5af1ed1a34c219c29b23c6ee49ce4) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:33.161371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:33.162866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624a772-f5b9-4df9-861d-3a32b1c95562 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:33.169245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 435/869] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:33 2022] GET /identity/v3/role_assignments?user.id=a3b5af1ed1a34c219c29b23c6ee49ce4&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:33.217201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ec5a-ec22-467f-95f9-36f8fa25a02e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:33.253648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:33.255201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:33.255682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:33.256170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:33.257085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:33.257612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:33.259279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569b6d7-7149-4b03-b3d8-1481ae8a35ec None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:33.265238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 435/870] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:34.629871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349390e1-dc67-41ec-848e-9c986cb2e328 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:34.630397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349390e1-dc67-41ec-848e-9c986cb2e328 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:34.630684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349390e1-dc67-41ec-848e-9c986cb2e328 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:34.633672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 436/871] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:34.640668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc509f-4aac-4c6a-a1dc-6d6cd6e93ca0 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:34.641071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc509f-4aac-4c6a-a1dc-6d6cd6e93ca0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:34.641272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc509f-4aac-4c6a-a1dc-6d6cd6e93ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:34.658799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-48cc509f-4aac-4c6a-a1dc-6d6cd6e93ca0 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:34.660021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-48cc509f-4aac-4c6a-a1dc-6d6cd6e93ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:34.724087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae1d5-9bb4-44b7-9124-aba7c52ebfb5 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:34.724394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae1d5-9bb4-44b7-9124-aba7c52ebfb5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:34.724681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 436/872] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:34.724799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aae1d5-9bb4-44b7-9124-aba7c52ebfb5 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:34.727953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 437/873] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:34.732353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:34.732649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:34.732931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:34.749276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae1d5-9bb4-44b7-9124-aba7c52ebfb5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:34.751580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:34.752731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:34.826672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 437/874] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:34.846267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:34.868555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aae1d5-9bb4-44b7-9124-aba7c52ebfb5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:34.912736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:34.914613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:34.915689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:34.916656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:34.918037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:34.921635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:34.951482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 438/875] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:34 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:34.964273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e0b44-5563-49b9-9e1c-4b6931359b93 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.007638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.008383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.008659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.008927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.020244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:35.028063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:51:35.029708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 438/876] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:51:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:35.036206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.160586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc0b7c-1509-4791-bdc9-c26dd95a97d0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.196816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.197523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.197805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.198081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.198864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:35.199170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.200537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.209413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 439/877] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:35.215125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.333873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4b992-4e76-4526-a857-991b320aadaa None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.366860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.368180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.368664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.369131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.380796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.382545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.399020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-75df9188-d144-4c54-ad03-0e83dfa98f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:35.400792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 439/878] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:35.407006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.505393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda425-fe02-48f0-b58a-67d13077a4b1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.524873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1209-192c-405d-9ef9-6e0a7a66037d None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.525454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1209-192c-405d-9ef9-6e0a7a66037d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.525934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b1209-192c-405d-9ef9-6e0a7a66037d None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.528183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 440/879] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:35.533571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b03-37dc-402f-8ce1-eeb16519571d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.534080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b03-37dc-402f-8ce1-eeb16519571d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.534629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3b03-37dc-402f-8ce1-eeb16519571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.538477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.539273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.539561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.539837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.540561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:35.540873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.542239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.553415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-690f3b03-37dc-402f-8ce1-eeb16519571d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:35.554922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-690f3b03-37dc-402f-8ce1-eeb16519571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:35.555532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 440/880] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:35.568172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.629376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 441/881] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:35.631069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f1c4-142c-4a02-bec5-c62d123577e9 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.631542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f1c4-142c-4a02-bec5-c62d123577e9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.631987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343f1c4-142c-4a02-bec5-c62d123577e9 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.633794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 442/882] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:35.646677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.646677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.646677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.658173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:35.659442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:35.667597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416facd0-144e-422d-bab3-38d845d8f9d5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.699007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.699829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.700115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.700387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.707609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.709087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.728606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 443/883] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:35.728606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.728931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:35.728931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 441/884] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:35.730015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.829594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bba3d-edfc-475e-8e80-4e21e7595178 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.846944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f0f3e-e089-4a4f-b871-f11b40f0411c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:35.864674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.865500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.865785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.866059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.866764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.868367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.879821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 01 09:51:35.880944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:35.881643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:35.881928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:35.882283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:35.883165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:35.883499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:35.884920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:35.886286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 444/885] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:35.888996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.907905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 442/886] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:35.907905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:35.991747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39442be-16ff-4184-bbe7-d11bd80c52df None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.004988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a498079-35ad-4afc-b52d-e76e6266bb18 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.026764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.027432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.027717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.028000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.028730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.030461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.041860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.042960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.043466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.043945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.044850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:36.045354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.046424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 445/887] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:35 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:36.047211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.047329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:36.065513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 443/888] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:36.066592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:36.183718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f425df-7cc6-476b-8905-7c6b79fcc207 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.201234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0a1a0-75d1-4ebf-8f96-3fcc506cdd47 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.221338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.222064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.222351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.222629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.223409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:36.223718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.225148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.237884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 444/889] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:36.246191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.247455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.248796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.248796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.327225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.329089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.433454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 446/890] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:51:36.439246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:36.542295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786bb76-94c0-4d29-80fb-5270771dc13c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.575300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee849-6c86-436f-babc-625937167672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.576107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee849-6c86-436f-babc-625937167672 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.576390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee849-6c86-436f-babc-625937167672 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.576668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ee849-6c86-436f-babc-625937167672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.587339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ee849-6c86-436f-babc-625937167672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.588796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ee849-6c86-436f-babc-625937167672 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.605716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-287ee849-6c86-436f-babc-625937167672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:36.607288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 445/891] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:36.612812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:36.707646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a0b38-1969-437e-9e7b-a4f7791f9395 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.740430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.741445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.741933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.742402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.743342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:36.743831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.745412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.756931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 447/892] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:36.762687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee849-6c86-436f-babc-625937167672 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:36.862020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ee849-6c86-436f-babc-625937167672 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:36.895202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:36.896406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:36.896904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:36.897371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:36.904319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:36.906381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:36.920122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:36.921932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 446/893] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:36.927998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:37.028072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b07be-0b04-4965-978c-ee124ca8ef24 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:37.069625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:37.070737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.071224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.071701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.072679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:37.073180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:37.074851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64453dd-cfb3-4fdb-a304-85dee74ea81a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:37.087636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 448/894] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:37.096259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:37.193580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68a9d-9948-4413-bb11-94c6ba35930d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:37.226446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:37.227504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.227974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.228444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.229455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] RBAC: Adding query filter params (role.id=f61503be93c347dd9ff2c09b226f2170, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=943154c0b9094ad79191f37028e30f73) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:37.229952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:37.231605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c872e-e0ee-4251-9c9c-8878a63b20a5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:37.237964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 447/895] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:37 2022] GET /identity/v3/role_assignments?user.id=943154c0b9094ad79191f37028e30f73&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f61503be93c347dd9ff2c09b226f2170 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:37.401550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fafa-3c4b-42e1-8449-bb446e73801a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.401894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fafa-3c4b-42e1-8449-bb446e73801a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.402107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15fafa-3c4b-42e1-8449-bb446e73801a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.404309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 449/896] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:37.410615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.411260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.411733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.435855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:37.437048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:37.502947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 448/897] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:37.525852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15fafa-3c4b-42e1-8449-bb446e73801a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:37.625704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15fafa-3c4b-42e1-8449-bb446e73801a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:37.659456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:37.660647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.661133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.661598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.662445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:37.664149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:37.675569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 01 09:51:37.677242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 450/898] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:37.682953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:37.778951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116476d-ecbe-4743-a911-051a58f172d4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:37.811933 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:37.812616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.812904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.813181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.813903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:37.814221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:37.815641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:37.820718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 449/899] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:37.826382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:37.923666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a554b-ac34-4e6a-8f02-252c10741591 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:37.957197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:37.958267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:37.958789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:37.959271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:37.960170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:37.960676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:37.962247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:37.967911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 451/900] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:37.978691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:38.071483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4644-4717-4d5e-b423-f76d05aeaf26 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:38.105876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:38.106547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.106858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.107134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.107947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] RBAC: Adding query filter params (interface=public, service_id=b7b0f699d97b4ba98b1754b24ecbe119, region_id=RegionOne) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:38.108258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:38.109645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0faa3-6772-4c55-ab36-ec89343f7592 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:38.115463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 450/901] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:37 2022] GET /identity/v3/endpoints?service_id=b7b0f699d97b4ba98b1754b24ecbe119&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:38.121234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:38.226785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14c11-5151-4e0f-b571-f57c086f4d08 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:38.263696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:38.264392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.264678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.264955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.265653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:38.267100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12386-1df1-4d02-a7de-def6cf8bcffe None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:38.273714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 452/902] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:38 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:51:38.495811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd3186-e6f1-478a-9162-4a3808ba4180 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.496109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd3186-e6f1-478a-9162-4a3808ba4180 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.496387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd3186-e6f1-478a-9162-4a3808ba4180 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.498434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 451/903] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:38.504154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78425d6-0aa0-4e1a-8684-da38b8ae77ee None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.504441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78425d6-0aa0-4e1a-8684-da38b8ae77ee None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.504720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78425d6-0aa0-4e1a-8684-da38b8ae77ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.521367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d78425d6-0aa0-4e1a-8684-da38b8ae77ee None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:38.522536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d78425d6-0aa0-4e1a-8684-da38b8ae77ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:38.590993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 453/904] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:38.613026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd3186-e6f1-478a-9162-4a3808ba4180 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:38.626789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776efdd-6dec-46da-aed7-6755bd1f1bc7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.627101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776efdd-6dec-46da-aed7-6755bd1f1bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.627358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776efdd-6dec-46da-aed7-6755bd1f1bc7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.629465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 454/905] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:38.634558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.635066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.635490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.652572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:38.654019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:38.713470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd3186-e6f1-478a-9162-4a3808ba4180 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:38.726763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 455/906] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:38.743933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:38.747318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:38.748376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.748839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.749281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.750124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:38.751679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:38.763363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 01 09:51:38.765036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 452/907] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Apr 1 09:51:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:38.770944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:38.840563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ad27c-6d82-4f17-91f2-142b24ac0e6f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:38.866526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbc39c-b933-4e3c-9661-7ff6d8309a69 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:38.875502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:38.876381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.876849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.877325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.878284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:38.879867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:38.902968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 456/908] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:38 2022] POST /identity/v3/services => generated 241 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:38.913311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:38.914052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:38.914342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:38.914621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:38.915393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:38.915742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:38.917217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:38.923312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 453/909] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:38.929381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:39.036842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f984dc5-ea3e-4837-9622-ba96a9d6bd99 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:39.071976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:39.072664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.072946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.073221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.074037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:39.074355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:39.075911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:39.082290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 457/910] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:39.088427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:39.194859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecd1a9-5158-493a-b5da-0945e2bf7ccd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:39.228489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:39.229608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.230101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.230572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.231670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] RBAC: Adding query filter params (interface=public, service_id=5be316577e2742b5b4f9aba8f00b5db4, region_id=RegionOne) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:39.232219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:39.233887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65400e09-703b-4763-b3b4-cd34e71323f3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:39.240740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 454/911] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:39 2022] GET /identity/v3/endpoints?service_id=5be316577e2742b5b4f9aba8f00b5db4&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:39.246039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:39.351031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6109b2-0181-48e7-ba43-910b420110aa None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:39.385077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:39.386250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.386783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.387302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.388210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:39.389806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad3073-01aa-4011-b83c-c000d1db5269 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:39.396583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 458/912] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:39 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:51:39.598875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcade25-543c-4a3f-b719-755142168adb None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.599531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcade25-543c-4a3f-b719-755142168adb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.599814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcade25-543c-4a3f-b719-755142168adb None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.601666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 455/913] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:39.607121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.607410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.607685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.625478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:39.626678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:39.691329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 459/914] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:39.714055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcade25-543c-4a3f-b719-755142168adb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:39.813747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcade25-543c-4a3f-b719-755142168adb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:39.847191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:39.848014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:39.848298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:39.848581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:39.858901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:39.866585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:51:39.868208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 456/915] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:51:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:39.874178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:39.971056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e641-3d5d-483f-b074-26b0fdc11d37 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.004991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.006027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.006507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.006989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.007918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:40.008394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.009935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.018546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 460/916] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:51:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:40.027920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.124267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4e10-ae25-4bf5-80c7-8a0b18b11cca None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.160354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.161226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.161509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.161785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.173918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.175466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.192079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:40.193686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 457/917] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:40.199468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.302120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0a56a-b3c5-4a1c-80f9-fad2f7cbfb1f None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.334221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.334921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.335202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.335474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.336199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:40.336504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.337876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.349893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 461/918] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:40.355454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.449827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14051023-5c2c-4fd4-97d4-06de9c892e3c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.498668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.498668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.498668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.498668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.501663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.503313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.517171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-0300291b-cb34-4234-9af1-364421b3a6bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:40.518739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 458/919] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:40.524344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.585460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328f04-2115-4d35-b809-5677f9776f5d None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.585770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328f04-2115-4d35-b809-5677f9776f5d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.586007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4328f04-2115-4d35-b809-5677f9776f5d None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.588028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 459/920] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:40.593119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.593399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.593674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.610631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:40.611832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:40.627097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1087f-7fd5-490e-939a-7354a65af377 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.668735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.669902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.670844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.671303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.672626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:40.673318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.675873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.686951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 460/921] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:40.695016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 462/922] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:40.700820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.702401 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.810830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfa83-5765-4cad-a168-4d6cbb3f7a77 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.816614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e7a52-abab-487a-90f8-d2e4dd81e5b1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.853279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.854111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.854390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.854685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.855133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:40.855347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.856107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:40.856521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:40.856755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.856957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:40.867159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:40.868866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:40.869554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 01 09:51:40.871558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 463/923] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:40.876921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.890423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:40.891951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 461/924] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:40.897939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:40.984460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f7efd-eccb-4268-80e9-670d26c2a5ba None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:40.998594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c826e-747c-4d78-bc01-6a6bb1c6d671 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.018055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.018781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.019063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.019336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.020052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:41.020357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.021698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.028967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 464/925] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:41.032677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.033352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.033742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.034021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.034840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:41.035153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.036136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.036526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.048600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 462/926] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:41.053768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.138187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01996-8aa2-4afa-a4b8-013b6d10e69a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.153804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8da9d-67e2-4ade-a282-2179d9c87bf4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.173153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.174197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.174755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.175285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.176199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:41.176689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.178254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.188377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 465/927] 10.222.0.46 () {56 vars in 1114 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:41.189860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.193710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.194549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.195589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.195589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.202592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.204196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.218092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:41.224457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 463/928] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:41.225454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.289782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d4e8-81ee-466e-bd97-567f4969da07 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.327119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.329095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.329377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.329646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.329742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ca8d2-3de3-4bfe-b463-eeac99c268d5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.330393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.331844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c12c-f933-4160-82ff-5b8939babdbd None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.352009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 466/929] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:41.360994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4333c6-08b3-4f9e-9d42-633fe581e05d None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.361970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4333c6-08b3-4f9e-9d42-633fe581e05d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.362678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4333c6-08b3-4f9e-9d42-633fe581e05d None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.365450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 467/930] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:41.372974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.373607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.374137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.377081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.377977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.378326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.378706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.379669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:41.380082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.381668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.397297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:41.398936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:41.400809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 464/931] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:41.401972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.503343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 468/932] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:41.527487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.533751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6278-915c-42a7-a904-05d815f01ce8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.579235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.580058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.580339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.580618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/943154c0b9094ad79191f37028e30f73/roles/f61503be93c347dd9ff2c09b226f2170` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.582979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=943154c0b9094ad79191f37028e30f73, role_id=f61503be93c347dd9ff2c09b226f2170)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.584442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.604700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 465/933] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:51:41 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/943154c0b9094ad79191f37028e30f73/roles/f61503be93c347dd9ff2c09b226f2170 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:51:41.651316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef749cf-95e2-4930-ac0e-16a3186b48de None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.688943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.690149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.690763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.691254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.692142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.693829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.706456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 01 09:51:41.712882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 469/934] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:41.715400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.828152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccb98b-f46e-40d4-abc0-e496b4422458 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.862777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:41.863751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.864228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.864673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.865556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:41.866030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:41.867605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c00cb-caa4-4ccb-bf66-566a4ad9f54b None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:41.873642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 466/935] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:41.879436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:41.886949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84436-c61e-4633-965f-f625083acd7c None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.887240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84436-c61e-4633-965f-f625083acd7c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.887515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84436-c61e-4633-965f-f625083acd7c None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.889516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 467/936] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:41.894415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:41.894722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:41.895002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:41.911839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:41.913031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:41.979419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c42ee-d7dc-49d5-8baf-dddbf4e69971 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:41.992609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 468/937] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:42.015998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.018564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.019321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.019607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.019884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.020594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:42.020905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.022403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.032704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 470/938] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:42.033965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.134159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8afb6-3a1a-4dd0-a1f7-1de38b335ab7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.135968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27ba0e-4bb9-47eb-8d66-e11895db88c1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.168776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.169442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.169723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.169825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.170015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.170555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.170818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] RBAC: Adding query filter params (interface=public, service_id=7ffef299b89e44449d7d88310c5b8442, region_id=RegionOne) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:42.170930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.171126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.171221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.171782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.172484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.173137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.180133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 471/939] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:42 2022] GET /identity/v3/endpoints?service_id=7ffef299b89e44449d7d88310c5b8442&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:42.186669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.187357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 01 09:51:42.194800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 469/940] 10.222.0.46 () {56 vars in 1132 bytes} [Fri Apr 1 09:51:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:42.196108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.291769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17712e-6058-456c-aece-bdb136f2beb9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.318214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecddcd5-85ce-4461-9f9a-d4977ac7bab0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.325196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.326046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.326436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.326852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.327668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.329148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.342850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 472/941] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:42 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:51:42.355663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.356611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.357053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.357491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.358365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:42.358843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.360399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.366704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 470/942] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:42.373972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.483480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9327d-f55c-4ac0-abf8-459c407e41f1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.519123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.519811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.520093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.520368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.521085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:42.521392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.522833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08323-744f-40ac-a12a-63c634420bae None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.528756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 473/943] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:42.534917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:42.636232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9dd1f-fc70-4419-bf83-17f080050014 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:42.669278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5829c30-0430-438a-8453-e975af140853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:42.669960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829c30-0430-438a-8453-e975af140853 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:42.670242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829c30-0430-438a-8453-e975af140853 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:42.670518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829c30-0430-438a-8453-e975af140853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:42.671299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829c30-0430-438a-8453-e975af140853 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:42.672684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829c30-0430-438a-8453-e975af140853 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:42.697154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 471/944] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:43.773161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e99c-a9f3-438b-8dd7-54b824afc0c3 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:43.774143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e99c-a9f3-438b-8dd7-54b824afc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:43.774616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e99c-a9f3-438b-8dd7-54b824afc0c3 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:43.776847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 474/945] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:43.782736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886871-cf99-42d8-9682-f0bdce63ad48 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:43.783616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886871-cf99-42d8-9682-f0bdce63ad48 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:43.784123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b886871-cf99-42d8-9682-f0bdce63ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:43.801360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9b886871-cf99-42d8-9682-f0bdce63ad48 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:43.802864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9b886871-cf99-42d8-9682-f0bdce63ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:43.874253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 472/946] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:43.897714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e99c-a9f3-438b-8dd7-54b824afc0c3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:43.951424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800489a-a920-419e-9176-d4dfec3e83d7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:43.951424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800489a-a920-419e-9176-d4dfec3e83d7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:43.951678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800489a-a920-419e-9176-d4dfec3e83d7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:43.954689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 473/947] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:43.958859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:43.959135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:43.959506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:43.976207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:43.977396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:44.002084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e99c-a9f3-438b-8dd7-54b824afc0c3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.037886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.038481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.038798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.039078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.039824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.041580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.043023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.common [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 01 09:51:44.052305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 474/948] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:44.064973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.sql.core [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 01 09:51:44.064973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 01 09:51:44.064973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [parameters: {'id': 'fefa213268c2497f94638135a34c041f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 01 09:51:44.064973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 01 09:51:44.076375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.083494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fefa213268c2497f94638135a34c041f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fefa213268c2497f94638135a34c041f. Apr 01 09:51:44.085660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 475/949] 10.222.0.46 () {60 vars in 1140 bytes} [Fri Apr 1 09:51:43 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:44.091803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.176532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f8a32-062c-4886-9463-9b0cc0079a04 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.191751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee5752-c4af-4556-99de-31e3cf6f19f3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.211220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.212094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.212382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.212662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.223222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:44.227900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.228944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.229413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.229886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.230768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:51:44.237019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 475/950] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:44.237475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.238488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.239744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.253398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:44.258760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 476/951] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:44.261276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.339512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81871c-1768-445e-b077-f314f9f4dd92 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.362921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db145-94c5-4706-bbc5-5f3e42f1dbee None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.376249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.376997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.377284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.377616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.378429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:44.378771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.380289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.395761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 476/952] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:44.397114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.400561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.401466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.401973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.402446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.403416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:44.403931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.405919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.434819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 477/953] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:44.504511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb63bd-0f0e-41ef-99bc-5b1d5772c167 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.540804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.541620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.541963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.542240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.554066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.555600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.573450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-8554a87d-a1c2-4a5f-897e-2b1665e183af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:44.578785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 477/954] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:44.581137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.685886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe99aa-818b-4129-bec0-3c6bb2510703 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.719645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.720325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.720613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.720893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.721670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:44.721981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.723525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.732113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23dd2-85af-49c6-a7a5-a5f342fe66d6 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.732734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23dd2-85af-49c6-a7a5-a5f342fe66d6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.733075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a23dd2-85af-49c6-a7a5-a5f342fe66d6 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.735145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 478/955] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:44.738780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 478/956] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:44.740140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.740688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.741194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.741375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.761421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:44.763018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:44.835936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 479/957] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:44.850137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d9c0a-e18d-4132-a85d-72e779f0e291 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:44.860130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.895910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:44.897108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:44.897741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:44.898979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:44.912598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:44.914815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:44.933228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 01 09:51:44.936062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 479/958] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:44.941507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:44.978044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9272f-eb2c-46c9-8701-ac85a7adc172 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.022560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.024189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.024889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.025312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.026274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.028102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.040389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3006e673-7c83-48b9-bc7e-ffc308de61a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 01 09:51:45.040533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969eef1-8096-4680-8aa6-047473ef405c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.041778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 480/959] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:45.042871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be540-147e-47aa-8f4d-f7deac7cb941 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.043159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be540-147e-47aa-8f4d-f7deac7cb941 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.043434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be540-147e-47aa-8f4d-f7deac7cb941 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.045081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 481/960] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:45.047290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be540-147e-47aa-8f4d-f7deac7cb941 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.076245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.076919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.077203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.077496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.078314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.078621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.080095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdf89e-4a5b-4540-a99d-e52e18cd09d4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.097773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 480/961] 10.222.0.46 () {56 vars in 1149 bytes} [Fri Apr 1 09:51:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:45.102703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.102703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.102703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.116954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:45.118455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:45.155481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be540-147e-47aa-8f4d-f7deac7cb941 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.181767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 481/962] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:45.183010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.198694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.199357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.200013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.200398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.201144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.201793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.203713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.209566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 482/963] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:45.210446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.285552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff56e1-894e-4eb6-82c5-5612237f8016 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.305212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a90fc8-a145-43e1-a27f-8f7a2684a537 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.318163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.318869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.319137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.319415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.338413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.339275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.339544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.339821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.340496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.341914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.352818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 01 09:51:45.354018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 483/964] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:45.354819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.386295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.387788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.474235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bb490-4d49-4910-8237-f1fb4abc0d44 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.485169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 482/965] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:51:45.486146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.516129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.516807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.517091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.517354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.518078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.518373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.519818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.530030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 484/966] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:45.530030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.585263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533cdc8-3970-4c45-be59-27fdb2587ee9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.619440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.620111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.620435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.620672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.621374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.621668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.623097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.624510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567e22-fc4a-469b-b855-b97602f95e12 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.632489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 483/967] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:45.632489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.659978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.660828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.661113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.661406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.673182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.674735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.691586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:45.693100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 485/968] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:45.693881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.738713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a243e-429f-4d34-9318-07bf2a1912b6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.774693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.775370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.775653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.775927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.776662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.778142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.810965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 484/969] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:45.810965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:45.813860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51479909-11db-4a3b-8176-990edc1e2c92 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.859198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.860100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.860538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.860905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.861980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] RBAC: Adding query filter params (type=compute) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.862449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.864202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.869952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 486/970] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:45.917238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fb3a7-097c-44b1-bfb5-14a0289580bf None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:45.955676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:45.956479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:45.956761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:45.957035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:45.957777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:45.958079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:45.959540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:45.973984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 485/971] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:45.980491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:46.087792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c34407-3cef-46b8-8e59-a3c669d38d5e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:46.126561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:46.127438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:46.127749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:46.128097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:46.135959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:46.137449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:46.151853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:46.153410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 487/972] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:46.159574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:46.257800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83a691-a7db-48ff-8574-773428b5f1c6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:46.292005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:46.292691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:46.292975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:46.293249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:46.294057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:46.294368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:46.295849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837eb37-2499-4bc7-b53c-ad3e1eea0672 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:46.312852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 486/973] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:46.314239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:46.413838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd07326-d55b-4ec4-81e0-45d169121500 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:46.446433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:46.447124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:46.447412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:46.447685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:46.448517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] RBAC: Adding query filter params (role.id=f61503be93c347dd9ff2c09b226f2170, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=943154c0b9094ad79191f37028e30f73) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:46.448828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:46.450263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce494d-9764-48e4-9a40-34ca73533ced None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:46.456579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 488/974] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:46 2022] GET /identity/v3/role_assignments?user.id=943154c0b9094ad79191f37028e30f73&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f61503be93c347dd9ff2c09b226f2170 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:46.859372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018095a-3867-4f80-83e6-68e0b8370f21 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:46.859559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018095a-3867-4f80-83e6-68e0b8370f21 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:46.859851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018095a-3867-4f80-83e6-68e0b8370f21 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:46.861844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 487/975] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:46.867406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:46.867940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:46.867940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:46.885658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:46.886880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:46.952755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 489/976] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:46.977159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018095a-3867-4f80-83e6-68e0b8370f21 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:47.081082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018095a-3867-4f80-83e6-68e0b8370f21 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:47.113983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:47.114597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:47.114905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:47.115185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:47.115895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:47.117338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:47.131040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.sql.core [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 01 09:51:47.131040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 01 09:51:47.131040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [parameters: {'user_id': '7bc34c93f64f4f6a8e286be8b0e4c035', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 01 09:51:47.131040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79775) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 01 09:51:47.137002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 01 09:51:47.138678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 488/977] 10.222.0.46 () {60 vars in 1131 bytes} [Fri Apr 1 09:51:46 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:47.145111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:47.245059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e87b0-99ba-4fad-abaf-595b52b7fabd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:47.277661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:47.278670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:47.279111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:47.279388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:47.287083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:47.288538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:47.303161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-34c81b76-9ce4-42a8-a3de-feb8602ae8a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 01 09:51:47.304707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 490/978] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:51:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:47.310785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:47.409408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24ef00-51cf-4ccb-9d5d-349ac0fc28d5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:47.441965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:47.442660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:47.442961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:47.443238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:47.444041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:47.444368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:47.446006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abae62-8448-4c1e-8e93-d2cb52bd8b66 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:47.489470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 489/979] 10.222.0.46 () {56 vars in 1101 bytes} [Fri Apr 1 09:51:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:48.194858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61084-014f-4273-b307-8204bf8f5770 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.197960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61084-014f-4273-b307-8204bf8f5770 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.197960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f61084-014f-4273-b307-8204bf8f5770 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.197960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 491/980] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:48.202843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.203306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.203394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.215298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9774-d68e-4cb6-8f68-5c55756d1ab1 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.215599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9774-d68e-4cb6-8f68-5c55756d1ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.215848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d9774-d68e-4cb6-8f68-5c55756d1ab1 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.217718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 492/981] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:48.221184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:48.222315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.222485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:48.222587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.222916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.239280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:48.240478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:48.288991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 490/982] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:48.304178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 493/983] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:48.311193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:48.327138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:48.434529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ae9c9-77c5-43c6-b153-a587a4b93beb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:48.476227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:48.476839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.477121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.477395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.478129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:48.479562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:48.498045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 494/984] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:48 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:48.544988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278de3ad-e156-416e-8b0c-ed214653a6ba None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:48.589251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:48.590081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.590357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.590621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.591373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:48.592776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:48.605366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 01 09:51:48.606873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 491/985] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:48.612979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:48.715460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd7e40-a7b3-4eef-8f38-49308737ff66 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:48.748848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:48.749446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.749732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.750009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.750752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:48.751059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:48.752458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46557f86-9a53-4233-b7d4-eed9e900f45e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:48.757488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 495/986] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:48.763374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:48.799486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fa67-5c5b-4052-adec-f983109cf0a0 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.799802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fa67-5c5b-4052-adec-f983109cf0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.800081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9fa67-5c5b-4052-adec-f983109cf0a0 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.802020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 496/987] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:48.807113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.807398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.807676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.825770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:48.827003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:48.869436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0396-6fc8-484f-8434-915de8be0eb4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:48.894151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 497/988] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:48.905406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:48.906077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:48.906364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:48.906673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:48.907376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:48.907681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:48.909095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:48.914131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 492/989] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:48.916719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:48.919636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:49.009250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb8f43-4e8e-4f4e-9355-8920b5336f0f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:49.025501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f582da0-dccd-4e16-8a55-f7aa32d414ff None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:49.042525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:49.043385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:49.043671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:49.043947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] PATH_INFO: `/v3/services/image` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:49.044607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:49.045992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:49.057155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 01 09:51:49.063466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 498/990] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Apr 1 09:51:48 2022] GET /identity/v3/services/image => generated 86 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:49.064229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:49.065647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:49.066306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:49.066584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:49.066891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:49.067686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] RBAC: Adding query filter params (interface=admin, service_id=7ffef299b89e44449d7d88310c5b8442, region_id=RegionOne) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:49.068015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:49.069333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:49.078676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 493/991] 10.222.0.46 () {56 vars in 1249 bytes} [Fri Apr 1 09:51:48 2022] GET /identity/v3/endpoints?service_id=7ffef299b89e44449d7d88310c5b8442&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:49.079528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:49.163548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad38c3c-b2fe-4974-8343-e59b19d5aefd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:49.176089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efb20-3575-40dc-91d4-424d342df20a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:49.196521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:49.197176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:49.197460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:49.197735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:49.198443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] RBAC: Adding query filter params (name=image) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:49.198780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:49.200151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:49.209769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 499/992] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:49.210813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:49.212691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:49.213372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:49.213678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:49.213938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:49.214656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:49.216044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6fcd-c542-4fe8-adfa-4aa170f8779e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:49.222420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 494/993] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:49 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:51:49.314120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc729fbe-5aef-4da5-9fe0-4a674db83c83 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:49.352021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:49.352711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:49.352959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:49.353268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:49.353984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] RBAC: Adding query filter params (type=image) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:49.354288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:49.355712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23ec32-f38c-4c88-ab07-173bd453e349 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:49.361216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 500/994] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:50.831974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e01e-dbde-4933-a8b0-48ab74082729 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:50.832479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e01e-dbde-4933-a8b0-48ab74082729 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:50.832479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129e01e-dbde-4933-a8b0-48ab74082729 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:50.834417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 495/995] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:50.839873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:50.840327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:50.840406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:50.857762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:50.859024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:50.927873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 501/996] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:50.951020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e01e-dbde-4933-a8b0-48ab74082729 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.052022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129e01e-dbde-4933-a8b0-48ab74082729 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.085827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.086539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.086858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.087118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] PATH_INFO: `/v3/services/compute` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.087792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.089161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.100191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 01 09:51:51.101602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 496/997] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:51.107539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.215533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5d880-e329-4267-9bee-ca1e3af137a5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.250024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.250695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.251014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.251260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.252012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:51.252317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.253832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.259731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 502/998] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:51.266310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.369408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d60bd2-5f57-4a76-9002-b57d138a755b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.402955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.403607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.403889 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.404166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.405231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:51.405536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.406937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23019106-869f-4587-8b02-e2285a24f381 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.411954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 497/999] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:51.417851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.497275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa0acd-40fb-4228-aa5a-49b89ba1f0b0 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.497571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa0acd-40fb-4228-aa5a-49b89ba1f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.497850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa0acd-40fb-4228-aa5a-49b89ba1f0b0 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.499937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 498/1000] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:51.504533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.504868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.505160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.520090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c26c8-960f-4e42-b4c3-2e6cee263e96 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.521727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:51.522958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:51.553880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.554539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.554977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.555259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.556047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] RBAC: Adding query filter params (interface=public, service_id=3c76f90342ee41ae831f4e1545c1f6e4, region_id=RegionOne) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:51.556350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.557732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.562598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 503/1001] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/endpoints?service_id=3c76f90342ee41ae831f4e1545c1f6e4&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:51.568204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.589432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 499/1002] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:51.614760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.664195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db2f2e-9eaf-4459-b538-83de1125e06e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.694731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.695395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.695680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.695957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.696635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.698009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabfce91-97d4-4177-97d0-96df1b920655 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.707591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 504/1003] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 09:51:51.707591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f0425-0858-476c-8702-b2b2794d7f8a None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.707591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f0425-0858-476c-8702-b2b2794d7f8a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.707591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f0425-0858-476c-8702-b2b2794d7f8a None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.707591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 505/1004] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:51.713040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.713646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.713646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.716625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558bd2f-e488-442b-96cb-07421bcbf9da None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.731527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:51.732762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:51.754412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.755278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.755559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.755831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.756493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.757896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.769987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 01 09:51:51.771772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 500/1005] 10.222.0.46 () {56 vars in 1126 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:51.777933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.804648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 506/1006] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:51.827667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.889035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e51712-0596-48c8-8d4e-092f9adbb4dc None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.925113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.925704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.925991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.926268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.927104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:51.927422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.927546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50e57f-e401-4ea7-802c-5ecd0cd8fe46 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:51.928899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.933849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 501/1007] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:51.939673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:51.960505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:51.961197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:51.961482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:51.961758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:51.962482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:51.963895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:51.978517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 507/1008] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:51 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:52.044896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40d420-cc94-4ed1-a7fd-873abb08cced None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:52.086415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:52.087117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:52.087398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:52.087665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:52.088369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:52.088669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:52.090049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d758e-0eda-4407-9668-3e7928e55936 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:52.099946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 502/1009] 10.222.0.46 () {56 vars in 1122 bytes} [Fri Apr 1 09:51:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:52.101850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:52.206327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29fb38-baa8-4691-89e4-4f01a54d3cd9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:52.237313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:52.237975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:52.238259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:52.238531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:52.239326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:52.240692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7663a-4307-4a70-b425-3421fde8ae77 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:52.262673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 508/1010] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:53.989730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455f6f-7417-4e83-9848-60e1b9633bf2 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:53.990281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455f6f-7417-4e83-9848-60e1b9633bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:53.990281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b455f6f-7417-4e83-9848-60e1b9633bf2 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:53.992068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 503/1011] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:53.997676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb055-fb1a-478e-be64-ac1a4a084a7c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:53.998112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb055-fb1a-478e-be64-ac1a4a084a7c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:53.998196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bb055-fb1a-478e-be64-ac1a4a084a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.015471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-222bb055-fb1a-478e-be64-ac1a4a084a7c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:54.016660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-222bb055-fb1a-478e-be64-ac1a4a084a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:54.089951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 509/1012] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:53 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:54.112933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b455f6f-7417-4e83-9848-60e1b9633bf2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.219310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b455f6f-7417-4e83-9848-60e1b9633bf2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.253469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.254193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.254476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.254761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] PATH_INFO: `/v3/services/compute` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.255446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.256818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.267900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 01 09:51:54.269351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 504/1013] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:54.271772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b601ae-c593-4b04-ab03-5a02ccae5728 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.272083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b601ae-c593-4b04-ab03-5a02ccae5728 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.272358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b601ae-c593-4b04-ab03-5a02ccae5728 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.274681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 510/1014] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:54.274943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.279705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.279999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.280299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.297081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:54.298274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:54.363416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 511/1015] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:54 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:54.380960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0dc8-f36a-484d-b564-44b400baf10c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.386797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.416407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.417088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.417376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.417656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.418368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] RBAC: Adding query filter params (name=compute) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:54.418699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.420087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.425046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 505/1016] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:54.430588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.483338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cecfc-f80b-4353-a97f-c5a2b3b30395 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.518415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.519219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.519505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.519793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] PATH_INFO: `/v3/services/image` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.520456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.521892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.527587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a7ca3-2aaa-4c71-a497-38f9e660382a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.532889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3841c10e-b0cd-4c74-821a-6ed99d7c0009 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 01 09:51:54.534165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 512/1017] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:54.535398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750f27-d252-429b-ad88-01080febaed7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.535686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750f27-d252-429b-ad88-01080febaed7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.535966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff750f27-d252-429b-ad88-01080febaed7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.537841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 513/1018] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:54.540006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750f27-d252-429b-ad88-01080febaed7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.561392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.562076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.562368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.562681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.563389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:54.563696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.565159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3be0-cb5b-461c-af16-86d55fa4b1d6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.569985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 506/1019] 10.222.0.46 () {56 vars in 1112 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:54.571302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.571593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.571934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.587578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:54.588789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:54.638553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff750f27-d252-429b-ad88-01080febaed7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.652507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 507/1020] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:54 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:54.653343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.671667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.672348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.672629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.672899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.673636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] RBAC: Adding query filter params (name=image) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:54.673900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.675362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.680403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 514/1021] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:54.681197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.747227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb539704-550e-40bf-a9a1-fb280004ac4b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.773762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c82d-b494-470e-8a45-f114c87a16aa None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.778687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.779668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.779951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.780224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.780956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.782327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.801054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 508/1022] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:51:54.801963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.812954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.814106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.814396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.814703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.816096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.817571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.819353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 515/1023] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:54.825412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.905349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9578b-ccd2-4142-9b5e-3e1a5be79ada None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.925171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee249a85-6fd4-4227-a3ff-6678b1790774 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:54.939055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.939729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.940047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.940329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.941057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] RBAC: Adding query filter params (type=image) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:54.941525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.942958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.953320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 509/1024] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:54.954487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:54.960563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:54.961236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:54.961514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:54.961788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:54.962503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:54.964011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:54.991261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 516/1025] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:51:54 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:55.062844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9a0a-bdcd-4689-a550-f2ecfc2f4d9c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:55.098869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:55.099856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:55.100290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:55.100712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:55.101674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] RBAC: Adding query filter params (interface=public, service_id=1ae3620130a64b4ba25c72b0ed203125, region_id=RegionOne) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:55.102159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:55.103867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f88e8d-d76e-498b-878e-9e979da69a2f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:55.110425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 510/1026] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:51:54 2022] GET /identity/v3/endpoints?service_id=1ae3620130a64b4ba25c72b0ed203125&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:55.116949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:55.220643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff045bd-e0f0-4be5-a654-cdd501568c47 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:55.254134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:55.254860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:55.255149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:55.255426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:55.256110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:55.257492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdac92-c5e8-45fb-850a-4e5dfd946349 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:55.264035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 517/1027] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:51:55 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:51:57.190124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e0d5-37f2-4be4-9163-5508f70f7765 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.190737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e0d5-37f2-4be4-9163-5508f70f7765 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.190737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3e0d5-37f2-4be4-9163-5508f70f7765 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.192453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 511/1028] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:57.198306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.198802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.198904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.217158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:57.218352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:57.300531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc24-0590-4bfa-9ebd-3db2d31f0249 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.300908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc24-0590-4bfa-9ebd-3db2d31f0249 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.301069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4adc24-0590-4bfa-9ebd-3db2d31f0249 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.303148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 512/1029] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:51:57.308824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.309150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.309391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.327387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:57.328713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:57.400243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 513/1030] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:51:57.418804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 518/1031] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:57.424995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.440083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.521860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57216268-7dfd-46da-ba93-659a0af86d25 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.542057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee646f-2f3b-4082-9aff-1846d1312564 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.554102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.554935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.555220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.555492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.556663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:57.558098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f551f-9ae3-43ca-8553-8248aefc7fd0 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:57.559724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 514/1032] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:57.560872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88392b-2831-47e3-9389-b1b844575d2f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.561155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88392b-2831-47e3-9389-b1b844575d2f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.561438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88392b-2831-47e3-9389-b1b844575d2f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.563098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 515/1033] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:51:57.565335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88392b-2831-47e3-9389-b1b844575d2f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.574858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.575675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.575956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.576228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.585834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:51:57.593207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3767986b-7d10-4e34-9a87-32a372163ff9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:51:57.594384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 519/1034] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:57.595544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.595826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.596154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.614288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:51:57.615719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:51:57.663728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88392b-2831-47e3-9389-b1b844575d2f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.679495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 520/1035] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:51:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:51:57.680312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.695028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.695700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.695984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.696262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.696965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:57.698424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:57.730673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 516/1036] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:51:57 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:57.730673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.797596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9a924-ff9b-41f9-8e4a-f8518f85e423 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.823795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0210-2164-4050-b76d-932241e418a9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.831956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.832670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.832940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.833212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.833987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:57.834293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:57.835723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:57.844426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 521/1037] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:57.850244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.859024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.859869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.860154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.860444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] PATH_INFO: `/v3/services/image` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:57.861127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:57.862847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:57.874296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 01 09:51:57.880480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 517/1038] 10.222.0.46 () {56 vars in 1105 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:57.882103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:57.954135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93e2b-357f-4a57-94e9-de0a41dadb26 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.979072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f59ee-fb4c-48c9-a5de-a46ee440d556 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:57.992454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:57.993241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:57.993524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:57.993793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.003700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.005131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.011491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455bee-306a-4273-b470-8636a330e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.012163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455bee-306a-4273-b470-8636a330e388 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.012446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455bee-306a-4273-b470-8636a330e388 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.012719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455bee-306a-4273-b470-8636a330e388 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.013428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89455bee-306a-4273-b470-8636a330e388 None admin] RBAC: Adding query filter params (name=image) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:58.013736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89455bee-306a-4273-b470-8636a330e388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.015138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89455bee-306a-4273-b470-8636a330e388 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.019895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 518/1039] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:58.022274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:58.023588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 522/1040] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:58.025695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455bee-306a-4273-b470-8636a330e388 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.029082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.118380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455bee-306a-4273-b470-8636a330e388 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.121926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4cdc-f1d1-4fc2-883c-3f55535ec713 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.150253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.150951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.151235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.151509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.152207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] RBAC: Adding query filter params (type=image) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:58.152509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.153873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.154548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.155260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.155536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.155802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.156516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:58.156815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.158151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.164299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 519/1041] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:58.165214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.170898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 523/1042] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:51:58.176703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.256229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-454a-4e2c-b353-a7f21dc23d10 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.267585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dfee6-705d-4985-8012-bd2008f7c8d2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.288189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.288842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.289125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.289654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.290136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.291526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.299256 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.300202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.300442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.300742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.307916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.309530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.310264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 520/1043] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:51:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:51:58.333607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:51:58.334924 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 524/1044] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:51:58.340991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.450432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c734-cd9f-459c-985b-80693e219bf4 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.487650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.488702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.489185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.489678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.490770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:58.491278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.493136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.510690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 521/1045] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:58.516877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.615291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8c8a8-4390-4600-8350-7440442e9f34 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.647784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.648569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.648854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.649127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.715306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.716656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.813692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 525/1046] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:51:58.819576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:58.920150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8eac7-4670-44e4-8bc0-8d5ade3d7574 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:58.953046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:58.953844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:58.954123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:58.954369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:58.964132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:58.965641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:58.982000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:51:58.983396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 522/1047] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:58.989140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:59.083774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3a3bf-369c-4e13-b2af-36c9a82a072a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:59.115180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:59.115837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:59.116116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:59.116389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:59.117100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:59.117400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:59.118789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:59.130003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 526/1048] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:59.135615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:59.229350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b507730-1c20-41b4-bd00-03b01468062a None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:59.273551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:59.274669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:59.275094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:59.275471 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:59.284666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:59.286815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:59.310391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:51:59.312733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 523/1049] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:51:59.321308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:59.421465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8083f-ec2b-432a-ba2c-363738cb275d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:59.454244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:59.454932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:59.455200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:59.455523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:59.456299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:59.456658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:59.458098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f1386-cbd7-4394-9a59-634d57e6fcd0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:59.471589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 527/1050] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:51:59.477855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:51:59.578274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530201-8a5d-418d-87cf-00096f75df92 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:51:59.611840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:51:59.612495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:51:59.612771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:51:59.613041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:51:59.613862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] RBAC: Adding query filter params (role.id=f61503be93c347dd9ff2c09b226f2170, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:51:59.614165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:51:59.615619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891f1da-c397-449e-aa50-d29e7c3a341a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:51:59.621117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 524/1051] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:51:59 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f61503be93c347dd9ff2c09b226f2170 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:00.068675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df440-7ddb-43e1-b0f9-5b51f3832e29 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.069084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df440-7ddb-43e1-b0f9-5b51f3832e29 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.069253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2df440-7ddb-43e1-b0f9-5b51f3832e29 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.071205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 528/1052] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:00.076391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.076642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.076953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.093966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:00.095216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:00.161799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 525/1053] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:00.185390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2df440-7ddb-43e1-b0f9-5b51f3832e29 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:00.289460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2df440-7ddb-43e1-b0f9-5b51f3832e29 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:00.324377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:00.325125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.325437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.325752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.335912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:00.342821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:00.344176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 529/1054] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:00.350060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:00.449822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60694e68-8882-4953-8d25-e04f5c7cac4c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:00.483638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:00.484316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.484601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.484878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.485627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:00.485933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:00.489930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1c9b6-7e9e-4a1b-9414-eb63d16a7dba None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:00.496970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 526/1055] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:00.501898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:00.601140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1613-fd70-40dd-9245-33d058481980 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:00.629139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64003c-3b6c-4bde-a369-4db42637c814 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.629760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64003c-3b6c-4bde-a369-4db42637c814 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.630038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64003c-3b6c-4bde-a369-4db42637c814 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.631861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 527/1056] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:00.634978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:00.635907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.636194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.636470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] PATH_INFO: `/v3/users/09a24e29ca0740818e2e7d5197e143b1` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.636859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.637142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.637416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.650985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] RBAC: Authorizing `identity:get_user(user_id=09a24e29ca0740818e2e7d5197e143b1)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:00.652434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:00.654566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 530/1057] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/users/09a24e29ca0740818e2e7d5197e143b1 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:00.659800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:00.660104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:00.661019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:00.727468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 528/1058] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:00.749273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:00.757568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42659a-2d68-4fb3-8daf-94fd4ee2bbc5 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:00.789841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:00.790489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.790805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.791082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.843067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b61ae-1679-400c-835a-b2b4e626eb23 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:00.853015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:00.854408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:00.874317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:00.874991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:00.875273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:00.875551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:00.943332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:00.944813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:00.946511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 531/1059] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:00.952157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:01.039212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 529/1060] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:01.043535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d0f5-348c-406b-8773-a09305fa315e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:01.045199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:01.078158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:01.079054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.079338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.079610 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.080847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:01.082284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:01.084143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 532/1061] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:00 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:01.089923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:01.138944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27682357-58c0-4893-8c35-4ddcadecdee1 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:01.172181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:01.172977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.173264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.173543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.183737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:01.185214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:01.189981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f6005-d71b-4e76-9c99-a124fe3b814f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:01.202698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:52:01.204084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 530/1062] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:01.209706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:01.223602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:01.224269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.224549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.224817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.225644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=71c9288686e0474a896df6b96afed411, user.id=09a24e29ca0740818e2e7d5197e143b1) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:01.225985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:01.227449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327cd6d-1f3f-4266-9212-7344983c0b31 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:01.232687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 533/1063] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:01 2022] GET /identity/v3/role_assignments?user.id=09a24e29ca0740818e2e7d5197e143b1&scope.project.id=71c9288686e0474a896df6b96afed411&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:01.318467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55980-9af1-49fc-a5ad-d60dd7071429 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:01.355726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:01.357119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.357552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.357971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.358901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:01.359385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:01.360929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888a9c-0b87-40ff-891a-76732ee085a1 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:01.378917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 531/1064] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:01.873831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872a42-2fe3-4cb8-b1db-d31363affacd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.874362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872a42-2fe3-4cb8-b1db-d31363affacd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.874362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872a42-2fe3-4cb8-b1db-d31363affacd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.876274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 534/1065] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:01.881610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:01.881900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:01.882176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:01.900874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:01.902072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:01.968661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 532/1066] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:01.991493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872a42-2fe3-4cb8-b1db-d31363affacd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.094718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872a42-2fe3-4cb8-b1db-d31363affacd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.128157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.128941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.129222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.129498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.139919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:02.147372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:52:02.148577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 535/1067] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:52:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:02.155234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.250357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965508d-1b1b-4d90-95b7-43d20f8be61b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.286110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.286834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.287118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.287393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.288146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:02.288461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:02.289840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:02.297852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 533/1068] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:02.303974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.408332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7865d-21be-4d1e-ad53-a0e3ac21d961 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.440943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.441727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.442006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.442273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.452587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:02.454020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:02.469781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:52:02.471222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 536/1069] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:02.477281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.575442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031564-c4ea-42b7-b859-eaa3d836401c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.608703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.609365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.609639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.609918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.610619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:02.610969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:02.612477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:02.624029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 534/1070] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:02.629836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.726902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1badf2-b919-44d8-9ae4-b9682ba7b2ac None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.759785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.760580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.760863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.761137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] PATH_INFO: `/v3/users/nova` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.768755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:02.770181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:02.783809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:52:02.784988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 537/1071] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:02.790913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:02.891001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27c761-383d-400d-9e20-1026ff1b8b3c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:02.925811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:02.926481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:02.926800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:02.927076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:02.927907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:02.928218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:02.929648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:02.946758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 535/1072] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:02.952510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.049560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b378ae4-a69b-48d5-b2fe-b3aff4e1392e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.081925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.082735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.083016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.083288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.093326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.094807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.110320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:52:03.111559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 538/1073] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:03.117355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.222507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b713-a5ba-498a-982f-3e25d5f819bb None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.256148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.256815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.257101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.257380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.258106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:03.258415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.260214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.271703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 536/1074] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:03.277636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.372303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274b943-a38d-4e90-8433-bee858b57469 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.405437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.406235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.406511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.406810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.413481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.414956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.428003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-8811a795-9cd1-43b5-9321-303a3b75742a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:52:03.429349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 539/1075] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:03.435465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.490095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763d5-233d-4ebe-9b2d-f8a9a16af991 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.490095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763d5-233d-4ebe-9b2d-f8a9a16af991 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.490095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16763d5-233d-4ebe-9b2d-f8a9a16af991 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.490713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 540/1076] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:52:03.495785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.496074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.496346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.513007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:03.514176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:03.533449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b030bc7-3b40-4edb-97d5-de310ee51144 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.565213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.565863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.566143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.566412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.567215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:03.567518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.568928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.578588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 541/1077] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:03.580502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 537/1078] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:03.586419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.601252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.683760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6374b-784f-4827-9b3e-939bd3a58879 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.703182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a958f-fac7-44b4-9c81-071e85f99f04 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.716209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.717104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.717381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.717630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/f61503be93c347dd9ff2c09b226f2170` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.719982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=e04e4b6a2827449dbe36886a303f7a10, role_id=f61503be93c347dd9ff2c09b226f2170)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.721450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.735514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 542/1079] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:52:03 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/e04e4b6a2827449dbe36886a303f7a10/roles/f61503be93c347dd9ff2c09b226f2170 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:52:03.744381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73771be-467c-462f-b158-204f074b5635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.745241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73771be-467c-462f-b158-204f074b5635 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.745518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73771be-467c-462f-b158-204f074b5635 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.745786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73771be-467c-462f-b158-204f074b5635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.757724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73771be-467c-462f-b158-204f074b5635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:03.764830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-a73771be-467c-462f-b158-204f074b5635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:03.766120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 538/1080] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:52:03.772997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:03.873185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2884cc-363d-4460-a770-3fa43e4c8f73 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:03.909350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:03.910027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:03.910307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:03.910586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:03.911368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:03.911673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:03.913085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:03.921963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 543/1081] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:03.928078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73771be-467c-462f-b158-204f074b5635 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:04.029588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73771be-467c-462f-b158-204f074b5635 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:04.062128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:04.063047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:04.063329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:04.063605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] PATH_INFO: `/v3/users/09a24e29ca0740818e2e7d5197e143b1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:04.064924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] RBAC: Authorizing `identity:get_user(user_id=09a24e29ca0740818e2e7d5197e143b1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:04.066393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:04.068089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 539/1082] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:03 2022] GET /identity/v3/users/09a24e29ca0740818e2e7d5197e143b1 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:04.073976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:04.174403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e2603-ea3e-4133-bb9c-3e85f15f63cc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:04.208419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:04.209282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:04.209565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:04.209840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:04.211091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:04.212520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b0010-4420-4d18-9dcd-166ec589b150 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:04.214193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 544/1083] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:04 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:04.220282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:04.319210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21201331-4a8b-4eff-bcc4-8a2976dfafe8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:04.352057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:04.352945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:04.353231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:04.353517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411/users/09a24e29ca0740818e2e7d5197e143b1/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:04.355600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] RBAC: Authorizing `identity:create_grant(project_id=71c9288686e0474a896df6b96afed411, user_id=09a24e29ca0740818e2e7d5197e143b1, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:04.357042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e20af-b92a-46f1-9323-9225a6ebe721 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:04.371977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 540/1084] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:52:04 2022] PUT /identity/v3/projects/71c9288686e0474a896df6b96afed411/users/09a24e29ca0740818e2e7d5197e143b1/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:52:06.068830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7295-f14d-4796-9e38-0a0fa4a8f40b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.069392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7295-f14d-4796-9e38-0a0fa4a8f40b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.069392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d7295-f14d-4796-9e38-0a0fa4a8f40b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.072137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 545/1085] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:06.080682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.081096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.081238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.098626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:06.099848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:06.164258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 541/1086] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:06.187597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7295-f14d-4796-9e38-0a0fa4a8f40b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.290419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d7295-f14d-4796-9e38-0a0fa4a8f40b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.327624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.328360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.328640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.328910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.338865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:06.346223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 01 09:52:06.347439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 546/1087] 10.222.0.46 () {56 vars in 1120 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:06.353458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.450510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea579412-0708-4255-8506-5a8a1de5f2f9 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.484805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.485464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.485737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.486004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.486869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:06.487202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:06.488555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e8de9-8fd4-402a-9ec7-8e63d7b8e9cb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:06.496575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 542/1088] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:06.502382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.603128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9030ef-4673-4c06-b136-8e8e4333eba1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.625432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb112e-f433-4d5c-a7f0-a8d99ba52312 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.625766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb112e-f433-4d5c-a7f0-a8d99ba52312 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.626004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb112e-f433-4d5c-a7f0-a8d99ba52312 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.628197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 543/1089] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:06.633145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.633436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.633713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.636186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.636987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.637310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.637583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.649150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:06.650605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:06.650980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:06.652161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:06.667797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:52:06.669046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 547/1090] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:06.674934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.717347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 544/1091] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:06.740827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.772272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c487a94-1d3c-4db3-b99a-3618e6b3dd2e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.804162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.804823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.805105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.805382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.806100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:06.806404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:06.807936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:06.819358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 548/1092] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:06.824947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.836762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4b98a-c3d7-4aeb-8b26-3fd2993c279a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.871731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.872453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.872739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.873012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.882754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:06.889606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:06.890957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 545/1093] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:06.896893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.916750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f475cc2-d739-4c12-8f00-50da2d128b84 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:06.947864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:06.948658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:06.949053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:06.949221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:06.956205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:06.957681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:06.970995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 01 09:52:06.972156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 549/1094] 10.222.0.46 () {56 vars in 1093 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:52:06.978068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:06.990125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f989138-6072-44d5-aa27-9607ec8b6ca8 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.022871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.023533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.023814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.024092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.024835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:07.025141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.026613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.034722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 546/1095] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:07.040479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.075707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ea423-c474-44d5-9878-1ca079d2a1c1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.107849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.108551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.108838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.109118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.109968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:07.110278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.111894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.129373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 550/1096] 10.222.0.46 () {56 vars in 1133 bytes} [Fri Apr 1 09:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:07.134068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f6ffb-01e6-4d20-8960-b60cceb4a576 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.135415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.167915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.168790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.169074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.169352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] PATH_INFO: `/v3/users/09a24e29ca0740818e2e7d5197e143b1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.170524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=09a24e29ca0740818e2e7d5197e143b1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.172029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.173672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 547/1097] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/users/09a24e29ca0740818e2e7d5197e143b1 => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:07.179507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.232171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b711b-4983-41a3-a502-a2baca19ed8f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.264713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.265361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.265644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.265915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.272278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a8d14-c503-4b2c-8210-36b9b5a2b6c5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.304707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.305354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.305644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.305925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.338416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.339925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.372165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.373608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.437416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 551/1098] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:07.443280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.469346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 548/1099] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 01 09:52:07.474953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.542922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9e937-b291-4911-9dfc-f08c57955564 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.568072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f05250-55e2-4f10-9411-2b3900f2ab75 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.576344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.577151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.577440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.577713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.587653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.589107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.601310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.602303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.602587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.602924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.604171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.605587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.605802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:52:07.607009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 552/1100] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:52:07.612444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 549/1101] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:07.612765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.613473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.706319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ec88-d867-437f-92b8-8621322cac62 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.708492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86070c-7ded-4e9d-80dc-a1d4866943ef None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.739457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.740123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.740406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.740680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.741221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.741380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:07.741684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.741876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.742144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.742418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.743088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.743279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=71c9288686e0474a896df6b96afed411, user.id=09a24e29ca0740818e2e7d5197e143b1) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:07.743596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.745010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.750589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 550/1102] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/role_assignments?user.id=09a24e29ca0740818e2e7d5197e143b1&scope.project.id=71c9288686e0474a896df6b96afed411&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:07.753980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 553/1103] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:07.759806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:07.859999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35b19b-1ed1-4f12-a6b6-7c33b10177ff None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:07.894335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:07.895182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:07.895460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:07.895733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:07.903018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:07.904892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:07.918727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:52:07.920213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 551/1104] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:07.926213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:08.025237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eed7d8-e439-4c96-95d9-49c0c1ca43db None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:08.058305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:08.059000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:08.059288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:08.059565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:08.060348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:08.060658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:08.062081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146026ce-8a71-4901-9b90-4d77cd977748 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:08.074078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 554/1105] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:08.080445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:08.179420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1c08c-2e5c-426b-82a3-651b640e3566 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:08.212735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:08.213384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:08.213667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:08.213948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:08.214812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] RBAC: Adding query filter params (role.id=f61503be93c347dd9ff2c09b226f2170, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=e04e4b6a2827449dbe36886a303f7a10) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:08.215124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:08.216557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676cac7-1dfc-4be7-a062-a1a99fec3a79 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:08.222418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 552/1106] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:08 2022] GET /identity/v3/role_assignments?user.id=e04e4b6a2827449dbe36886a303f7a10&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f61503be93c347dd9ff2c09b226f2170 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:10.040697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5cc82-a804-42fa-86f4-745973905e01 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:10.041535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5cc82-a804-42fa-86f4-745973905e01 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:10.041535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5cc82-a804-42fa-86f4-745973905e01 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:10.044388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 555/1107] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:10.051829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:10.052291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:10.052382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:10.070807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:10.071986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:10.137838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 553/1108] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:10.163252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5cc82-a804-42fa-86f4-745973905e01 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:10.278524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5cc82-a804-42fa-86f4-745973905e01 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:10.320366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:10.321090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:10.321372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:10.321652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:10.322885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:10.324326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555addd-9325-4bfb-86f1-c7d86c86aad6 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:10.325892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 556/1109] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:10.334564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:10.436672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9127db4-9a83-4f59-8cef-c7456c80c3e7 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:10.476287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:10.477230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:10.477613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:10.477983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:10.479152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:10.481436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912bb1a-2659-4613-a590-75549ea95b8c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:10.505963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 554/1110] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:52:10 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:52:12.803080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26d37-918a-43fe-b98d-e707cd0a3fce None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:12.803624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26d37-918a-43fe-b98d-e707cd0a3fce None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:12.803624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf26d37-918a-43fe-b98d-e707cd0a3fce None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:12.806300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 557/1111] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:12.815524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:12.815927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:12.816114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:12.839226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:12.840397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:12.908009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 555/1112] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:12.937976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26d37-918a-43fe-b98d-e707cd0a3fce None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:13.041172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf26d37-918a-43fe-b98d-e707cd0a3fce None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:13.075811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:13.076606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:13.076902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:13.077180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] PATH_INFO: `/v3/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:13.078830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] RBAC: Authorizing `identity:get_role(role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:13.080216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:13.081647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 558/1113] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:12 2022] GET /identity/v3/roles/ec45838429e4491ea0215d21e1e01239 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:13.088324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:13.197082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ee6d-33c1-42bf-b01d-caad810f9a6c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:13.230544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:13.231451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:13.231727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:13.231998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] PATH_INFO: `/v3/users/531d17d0b94a4ba0a5058cbffa04d752` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:13.245200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] RBAC: Authorizing `identity:get_user(user_id=531d17d0b94a4ba0a5058cbffa04d752)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:13.246629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:13.248258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 556/1114] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:13 2022] GET /identity/v3/users/531d17d0b94a4ba0a5058cbffa04d752 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:13.254949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:13.366581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396804f-9a4a-4952-8432-1fd6326f2814 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:13.400195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:13.400835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:13.401114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:13.401380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:13.465673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:13.467112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:13.561858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 559/1115] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:13.571822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:13.686089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079dd8f-8127-4206-90e9-29585b73d090 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:13.719484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:13.720333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:13.720607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:13.720871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:13.722162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:13.723626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eec84-8b1e-4603-bf59-a10dd111fb80 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:13.725279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 557/1116] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:13 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:13.731337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:13.827182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26397081-9d74-4d8a-940d-65894c1f7a79 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:13.860247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:13.860879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:13.861152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:13.861426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:13.862415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=71c9288686e0474a896df6b96afed411, user.id=531d17d0b94a4ba0a5058cbffa04d752) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:13.862753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:13.864176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116659a2-098f-4a58-888d-71d1568356d0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:13.869497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 560/1117] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:13 2022] GET /identity/v3/role_assignments?user.id=531d17d0b94a4ba0a5058cbffa04d752&scope.project.id=71c9288686e0474a896df6b96afed411&role.id=ec45838429e4491ea0215d21e1e01239 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:16.106933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658e26-9ee5-4c69-a09e-b1e648ea0808 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.107829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658e26-9ee5-4c69-a09e-b1e648ea0808 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.107829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658e26-9ee5-4c69-a09e-b1e648ea0808 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.110711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 558/1118] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:16.117034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.117481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.117575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.136415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:16.137590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:16.202833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 561/1119] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:16.225450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658e26-9ee5-4c69-a09e-b1e648ea0808 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:16.330083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658e26-9ee5-4c69-a09e-b1e648ea0808 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:16.363715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:16.364502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.364785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.365057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] PATH_INFO: `/v3/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.366575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] RBAC: Authorizing `identity:get_role(role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:16.367987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:16.369323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 559/1120] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:16 2022] GET /identity/v3/roles/ec45838429e4491ea0215d21e1e01239 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:16.378144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:16.475770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb93f1e-da55-425f-9c7c-772b79879559 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:16.511704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:16.512589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.512868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.513159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] PATH_INFO: `/v3/users/531d17d0b94a4ba0a5058cbffa04d752` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.514394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] RBAC: Authorizing `identity:get_user(user_id=531d17d0b94a4ba0a5058cbffa04d752)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:16.515876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:16.517535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 562/1121] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:16 2022] GET /identity/v3/users/531d17d0b94a4ba0a5058cbffa04d752 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:16.523783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:16.627482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f19b2-8578-433c-bfef-1f018ce6ead2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:16.672869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:16.673715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.673990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.674329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.675674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:16.677090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dfbf4-d0ef-47f4-808d-f3800ff2be63 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:16.678766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 560/1122] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:16 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:16.684941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:16.791003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354550-92b3-4570-b7af-25a8408f3628 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:16.824230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:16.825114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:16.825506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:16.825786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411/users/531d17d0b94a4ba0a5058cbffa04d752/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:16.828391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] RBAC: Authorizing `identity:create_grant(project_id=71c9288686e0474a896df6b96afed411, user_id=531d17d0b94a4ba0a5058cbffa04d752, role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:16.829851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6960c-08f2-472c-8cee-b933c02d9a92 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:16.848605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 563/1123] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:52:16 2022] PUT /identity/v3/projects/71c9288686e0474a896df6b96afed411/users/531d17d0b94a4ba0a5058cbffa04d752/roles/ec45838429e4491ea0215d21e1e01239 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:52:19.082525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28d8c-568a-4963-b562-89d5bb3f5b2b None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.083477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28d8c-568a-4963-b562-89d5bb3f5b2b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.083477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f28d8c-568a-4963-b562-89d5bb3f5b2b None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.086346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 561/1124] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:19.091733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.092154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.092265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.110605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:19.111879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:19.177004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 564/1125] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:19.201116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28d8c-568a-4963-b562-89d5bb3f5b2b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:19.314567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f28d8c-568a-4963-b562-89d5bb3f5b2b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:19.347615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:19.348398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.348678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.348945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] PATH_INFO: `/v3/roles/ec45838429e4491ea0215d21e1e01239` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.350506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] RBAC: Authorizing `identity:get_role(role_id=ec45838429e4491ea0215d21e1e01239)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:19.351907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:19.353249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 562/1126] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:19 2022] GET /identity/v3/roles/ec45838429e4491ea0215d21e1e01239 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:19.361862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:19.463656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee12c7-1324-4160-8bd7-298f4cc6d106 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:19.504148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:19.505036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.505316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.505591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] PATH_INFO: `/v3/users/531d17d0b94a4ba0a5058cbffa04d752` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.506887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] RBAC: Authorizing `identity:get_user(user_id=531d17d0b94a4ba0a5058cbffa04d752)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:19.508349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:19.509975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 565/1127] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:19 2022] GET /identity/v3/users/531d17d0b94a4ba0a5058cbffa04d752 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:19.516898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:19.620489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb529b5-3c49-4e0a-9162-6761565cb044 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:19.657616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:19.658245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.658568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.658874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.724484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:19.725936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:19.819279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 563/1128] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:19.828846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:19.953978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01baa-9788-417c-9d76-8c8e11dab67c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:19.987256 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:19.988118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:19.988398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:19.988670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] PATH_INFO: `/v3/projects/71c9288686e0474a896df6b96afed411` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:19.989975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] RBAC: Authorizing `identity:get_project(project_id=71c9288686e0474a896df6b96afed411)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:19.991446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06b7b-0398-4d1a-b334-4b56cda66e6f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:19.993163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 566/1129] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:19 2022] GET /identity/v3/projects/71c9288686e0474a896df6b96afed411 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:20.000379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:20.105108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536a4f-daa3-42a9-bad5-08770614dd90 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:20.139258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:20.139899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:20.140185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:20.140468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:20.141292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] RBAC: Adding query filter params (role.id=ec45838429e4491ea0215d21e1e01239, scope.project.id=71c9288686e0474a896df6b96afed411, user.id=531d17d0b94a4ba0a5058cbffa04d752) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:20.141603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:20.143087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fbd8-9c5f-4832-88dc-535bd4b43b95 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:20.148824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 564/1130] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:19 2022] GET /identity/v3/role_assignments?user.id=531d17d0b94a4ba0a5058cbffa04d752&scope.project.id=71c9288686e0474a896df6b96afed411&role.id=ec45838429e4491ea0215d21e1e01239 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:22.415743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e874e6-e1d4-41b6-9cba-2bf8bf02daaf None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:22.416594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e874e6-e1d4-41b6-9cba-2bf8bf02daaf None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:22.416594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e874e6-e1d4-41b6-9cba-2bf8bf02daaf None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:22.419576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 567/1131] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:22.426048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:22.426484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:22.426618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:22.449624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:22.450848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:22.517238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 565/1132] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:22.552889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e874e6-e1d4-41b6-9cba-2bf8bf02daaf None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:22.664853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e874e6-e1d4-41b6-9cba-2bf8bf02daaf None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:22.697073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:22.697804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:22.698079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:22.698349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:22.699565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:22.701017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f517aa-5bf9-4ae7-bad0-c978bcc09861 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:22.702667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 568/1133] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:22.708828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:22.811063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113dc18-4fcd-4ec1-9915-7b7460bc17ed None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:22.846606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:22.847377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:22.847655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:22.847931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:22.848650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:22.850092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b729b0-b415-4d4b-b0ed-92413a4c7185 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:22.879438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 566/1134] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:52:22 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:52:25.158839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10847a-217e-41a5-8fbd-33d8c8cfe961 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:25.159820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10847a-217e-41a5-8fbd-33d8c8cfe961 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:25.159820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10847a-217e-41a5-8fbd-33d8c8cfe961 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:25.162630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 569/1135] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:25.169083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:25.169518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:25.169653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:25.195438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:25.196611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:25.263911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 567/1136] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:25.296494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10847a-217e-41a5-8fbd-33d8c8cfe961 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:25.411101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10847a-217e-41a5-8fbd-33d8c8cfe961 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:25.446578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:25.447425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:25.447706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:25.447979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:25.449231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:25.450691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff983b11-ec1e-4657-b6c0-2d50e704c8bf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:25.452324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 570/1137] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:25.461435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:25.567210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba4717-12ec-4eb9-97ce-d391f6f5e8e8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:25.600014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:25.600672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:25.600950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:25.601202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:25.601916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:25.603394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa19b1a-f144-48a8-b2fd-7403cd7d181d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:25.624954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 568/1138] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:52:25 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:52:27.918423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5a312-77f6-4ecd-af97-c532c2bf0f42 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:27.919359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5a312-77f6-4ecd-af97-c532c2bf0f42 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:27.919359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5a312-77f6-4ecd-af97-c532c2bf0f42 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:27.922172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 571/1139] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:27.931204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:27.931610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:27.931810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:27.953796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:27.955041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:28.020755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 569/1140] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:28.045804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5a312-77f6-4ecd-af97-c532c2bf0f42 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:28.154331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5a312-77f6-4ecd-af97-c532c2bf0f42 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:28.187828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:28.188544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:28.188818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:28.189083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:28.199562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:28.206317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:28.207501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 572/1141] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:28.217065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:28.334548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b61e-f722-416a-b802-d724f2730398 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:28.368491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:28.369167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:28.369445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:28.369718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:28.370460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:28.370791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:28.372170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:28.380105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 570/1142] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:28.386403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:28.483859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70e247-2040-4c34-b78f-2c7821d419d6 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:28.516363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:28.517231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:28.517508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:28.517778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] PATH_INFO: `/v3/users/80f5c5bede7b46ce80645703f9bc533c` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:28.531832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] RBAC: Authorizing `identity:get_user(user_id=80f5c5bede7b46ce80645703f9bc533c)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:28.533264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:28.534910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 573/1143] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:28 2022] GET /identity/v3/users/80f5c5bede7b46ce80645703f9bc533c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:28.541051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:28.654450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274108c8-654b-4dbe-89ad-c36f5df1cc85 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:28.690434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:28.691107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:28.691389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:28.691666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:28.758971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:28.760343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:28.859734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 571/1144] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:28.867739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:28.974727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd9f44-05f4-4340-b1b5-19db28992898 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:29.010627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:29.011462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:29.011745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:29.012015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] PATH_INFO: `/v3/projects/7969dc24f41349868c17aa33bd6598db` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:29.013242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] RBAC: Authorizing `identity:get_project(project_id=7969dc24f41349868c17aa33bd6598db)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:29.014683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a6f1a-6e18-4b42-b547-29e3bcf7de9e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:29.016721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 574/1145] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:28 2022] GET /identity/v3/projects/7969dc24f41349868c17aa33bd6598db => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:29.024994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:29.140476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb9edc-948a-4089-b85d-fabb6781aab9 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:29.175576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:29.176217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:29.176546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:29.176818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:29.177640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=7969dc24f41349868c17aa33bd6598db, user.id=80f5c5bede7b46ce80645703f9bc533c) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:29.177943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:29.179400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e89bc-b780-4f66-a2d5-4bef38fef26b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:29.184595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 572/1146] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:29 2022] GET /identity/v3/role_assignments?user.id=80f5c5bede7b46ce80645703f9bc533c&scope.project.id=7969dc24f41349868c17aa33bd6598db&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:31.395674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393e7-271f-4eee-9cb1-c79698d1f361 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:31.396605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393e7-271f-4eee-9cb1-c79698d1f361 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:31.396605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98393e7-271f-4eee-9cb1-c79698d1f361 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:31.399535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 575/1147] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:31.405366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:31.405794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:31.405887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:31.424338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:31.425492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:31.494096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 573/1148] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:31.517028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98393e7-271f-4eee-9cb1-c79698d1f361 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:31.639491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98393e7-271f-4eee-9cb1-c79698d1f361 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:31.673778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:31.674506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:31.674822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:31.675102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:31.685754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:31.692718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:31.693904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 576/1149] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:31.703050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:31.800279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d695-504a-411f-9272-3a4706d9f76e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:31.833588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:31.834229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:31.834510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:31.834809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:31.835542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:31.835844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:31.837209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:31.845003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 574/1150] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:31.852251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:31.950818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8acce-ebd2-4466-8fe2-57834474ff1d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:31.983977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:31.984852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:31.985135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:31.985417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] PATH_INFO: `/v3/users/80f5c5bede7b46ce80645703f9bc533c` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:31.986700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] RBAC: Authorizing `identity:get_user(user_id=80f5c5bede7b46ce80645703f9bc533c)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:31.988138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:31.990121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 577/1151] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:31 2022] GET /identity/v3/users/80f5c5bede7b46ce80645703f9bc533c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:31.996411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:32.113520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f931a-adbf-4cfc-9aca-46e955a65359 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:32.154880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:32.155724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:32.156000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:32.156270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] PATH_INFO: `/v3/projects/7969dc24f41349868c17aa33bd6598db` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:32.157577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] RBAC: Authorizing `identity:get_project(project_id=7969dc24f41349868c17aa33bd6598db)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:32.159028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e8289-e966-4291-9ecd-074e0ee158ee None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:32.160726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 575/1152] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:31 2022] GET /identity/v3/projects/7969dc24f41349868c17aa33bd6598db => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:32.167289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:32.274995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4b16e-5fac-4765-be5b-711f9b6476f9 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:32.310444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:32.311366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:32.311647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:32.311925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] PATH_INFO: `/v3/projects/7969dc24f41349868c17aa33bd6598db/users/80f5c5bede7b46ce80645703f9bc533c/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:32.314007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] RBAC: Authorizing `identity:create_grant(project_id=7969dc24f41349868c17aa33bd6598db, user_id=80f5c5bede7b46ce80645703f9bc533c, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:32.315481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3cf2e-d989-4b12-b213-5d95da0c3601 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:32.331420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 578/1153] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:52:32 2022] PUT /identity/v3/projects/7969dc24f41349868c17aa33bd6598db/users/80f5c5bede7b46ce80645703f9bc533c/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:52:34.563101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5dd6e-cb20-4b25-b084-49b15ca136e2 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:34.563641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5dd6e-cb20-4b25-b084-49b15ca136e2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:34.563641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5dd6e-cb20-4b25-b084-49b15ca136e2 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:34.565457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 576/1154] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:34.572109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:34.572797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:34.572992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:34.600248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:34.601490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:34.670080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 579/1155] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:34.694387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5dd6e-cb20-4b25-b084-49b15ca136e2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:34.809596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5dd6e-cb20-4b25-b084-49b15ca136e2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:34.842578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:34.843404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:34.843689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:34.843964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:34.854941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:34.861667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:34.862845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 577/1156] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:34.872332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:34.979862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec68b5-0918-4750-adda-bfa0a4f2ccbd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:35.014267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:35.014953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:35.015235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:35.015510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:35.016274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:35.016584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:35.017947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:35.025945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 580/1157] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:35.032122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:35.134065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cade4c-5f44-4dbb-b692-588875fd0746 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:35.168300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:35.169182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:35.169467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:35.169743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] PATH_INFO: `/v3/users/80f5c5bede7b46ce80645703f9bc533c` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:35.171105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] RBAC: Authorizing `identity:get_user(user_id=80f5c5bede7b46ce80645703f9bc533c)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:35.172563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:35.174164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 578/1158] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:35 2022] GET /identity/v3/users/80f5c5bede7b46ce80645703f9bc533c => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:35.183194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:35.292522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ca655-9a1f-4693-b79e-55b516252c1e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:35.325131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:35.325766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:35.326050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:35.326328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:35.390903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:35.392294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:35.487018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 581/1159] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:35.493166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:35.593981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3c26-2b99-4d6f-b5a4-b3c541652ddd None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:35.631064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:35.631923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:35.632204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:35.632485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] PATH_INFO: `/v3/projects/7969dc24f41349868c17aa33bd6598db` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:35.633739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] RBAC: Authorizing `identity:get_project(project_id=7969dc24f41349868c17aa33bd6598db)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:35.635212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e636e-3459-4686-87c3-05f9313b952c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:35.636904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 579/1160] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:35 2022] GET /identity/v3/projects/7969dc24f41349868c17aa33bd6598db => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:35.644024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:35.765313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de756c23-4ddc-4b4b-8a84-8448fea6f8ec None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:35.798981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:35.799632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:35.799913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:35.800189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:35.801068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=7969dc24f41349868c17aa33bd6598db, user.id=80f5c5bede7b46ce80645703f9bc533c) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:35.801383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:35.802863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dbb05-47ad-46d5-a072-a219a1e949bf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:35.808659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 582/1161] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:35 2022] GET /identity/v3/role_assignments?user.id=80f5c5bede7b46ce80645703f9bc533c&scope.project.id=7969dc24f41349868c17aa33bd6598db&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:38.112316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba0511-e398-47ce-b242-b4fffbcf820a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:38.112935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba0511-e398-47ce-b242-b4fffbcf820a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:38.112935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba0511-e398-47ce-b242-b4fffbcf820a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:38.114777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 580/1162] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:38.120634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:38.121104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:38.121208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:38.145764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:38.147004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:38.216373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 583/1163] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:38.244793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba0511-e398-47ce-b242-b4fffbcf820a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:38.353921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba0511-e398-47ce-b242-b4fffbcf820a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:38.388428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:38.389060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:38.389319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:38.389599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:38.457800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:38.459270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:38.562881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 581/1164] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:38.570093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:38.682954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3968107-d60b-4cf4-ae77-e99ddc3aed00 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:38.716460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:38.717257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:38.717536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:38.717807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:38.724884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:38.726346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:38.740574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-c3533822-2553-4fb9-904e-c2ad550c9d75 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 01 09:52:38.741712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 584/1165] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:52:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:38.750556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:38.851580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f7ca1-7983-4a73-a9f3-fc821245e85d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:38.886110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:38.886781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:38.887064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:38.887335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:38.888075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:38.888383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:38.889750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c24de-f45d-4050-81a6-f119782cf888 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:38.896869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 582/1166] 10.222.0.46 () {56 vars in 1115 bytes} [Fri Apr 1 09:52:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:41.147010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa738-50bf-448e-9ae3-435f5e3fd01a None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:41.147904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa738-50bf-448e-9ae3-435f5e3fd01a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:41.147904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaa738-50bf-448e-9ae3-435f5e3fd01a None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:41.150846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 585/1167] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:41.160130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d506-3e95-4f64-b2d8-663345b013d5 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:41.160556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d506-3e95-4f64-b2d8-663345b013d5 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:41.160721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6d506-3e95-4f64-b2d8-663345b013d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:41.183756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a9f6d506-3e95-4f64-b2d8-663345b013d5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:41.184925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a9f6d506-3e95-4f64-b2d8-663345b013d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:41.250601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 583/1168] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:41.273779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa738-50bf-448e-9ae3-435f5e3fd01a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:41.383757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaa738-50bf-448e-9ae3-435f5e3fd01a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:41.420155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:41.420749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:41.421030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:41.421315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:41.422080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:41.423509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c35645-ef1e-47da-837b-1715b8f7dee0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:41.442488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 586/1169] 10.222.0.46 () {60 vars in 1138 bytes} [Fri Apr 1 09:52:41 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:52:43.732628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d081-582a-4ab2-b509-a972814f0e76 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:43.733215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d081-582a-4ab2-b509-a972814f0e76 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:43.733215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480d081-582a-4ab2-b509-a972814f0e76 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:43.734993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 584/1170] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:43.741267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:43.742021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:43.742219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:43.770687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:43.772588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:43.845657 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 587/1171] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:43.876053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480d081-582a-4ab2-b509-a972814f0e76 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:43.988441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480d081-582a-4ab2-b509-a972814f0e76 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:44.021553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:44.022373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:44.022681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:44.022962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] PATH_INFO: `/v3/domains/7307fb9d3fb5486a8d790fefcd54820b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:44.033270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7307fb9d3fb5486a8d790fefcd54820b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:44.034732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccab3b-45a8-404b-9dc2-61e78d1745a3 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:44.036362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 585/1172] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Apr 1 09:52:43 2022] GET /identity/v3/domains/7307fb9d3fb5486a8d790fefcd54820b => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:44.043029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:44.141983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999cfc-47ed-4d4d-8adb-cca077cae72a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:44.176395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:44.177057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:44.177341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:44.177611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:44.178301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:44.179751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30691a55-7806-463a-b786-d38a42d32448 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:44.207101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 588/1173] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:52:44 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:52:46.495285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd0af-a886-4e49-b659-5a48a275468e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:46.495759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd0af-a886-4e49-b659-5a48a275468e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:46.495858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbd0af-a886-4e49-b659-5a48a275468e None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:46.497629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 586/1174] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:46.503298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:46.503839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:46.503946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:46.521024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:46.522209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:46.588277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 589/1175] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:46.616706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd0af-a886-4e49-b659-5a48a275468e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:46.724804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbd0af-a886-4e49-b659-5a48a275468e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:46.757850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:46.758638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:46.758962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:46.759227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] PATH_INFO: `/v3/domains/7307fb9d3fb5486a8d790fefcd54820b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:46.760429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=7307fb9d3fb5486a8d790fefcd54820b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:46.761861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16ffe0-3ee5-4983-8c52-3034a62099bd None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:46.763511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 587/1176] 10.222.0.46 () {56 vars in 1183 bytes} [Fri Apr 1 09:52:46 2022] GET /identity/v3/domains/7307fb9d3fb5486a8d790fefcd54820b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:46.770179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:46.874194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bcad8-622d-4bc6-8a01-375d4f02bc10 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:46.910159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:46.910846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:46.911129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:46.911403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:46.912126 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:46.913559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ff383-456e-46ad-afbd-873581b82377 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:46.935911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 590/1177] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:52:46 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:52:49.223817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167a556-7d5f-424c-9c3c-b4b45b38bc2a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.224411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167a556-7d5f-424c-9c3c-b4b45b38bc2a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.224411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167a556-7d5f-424c-9c3c-b4b45b38bc2a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:49.226157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 588/1178] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:49.232504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.233234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.233405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:49.254444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:49.255679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:49.323978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 591/1179] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:49.350522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167a556-7d5f-424c-9c3c-b4b45b38bc2a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:49.453500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167a556-7d5f-424c-9c3c-b4b45b38bc2a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:49.489116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:49.489831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.490110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.490378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:49.500874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:49.507747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:49.508937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 589/1180] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:49.515340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:49.623467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70d78-367e-4e76-bb6d-f1ef63b0d8a3 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:49.662831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:49.663502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.663788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.664064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:49.664811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:49.665119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:49.666514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:49.676054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 592/1181] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:49.682146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:49.785800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787ee0a-7419-43f9-930f-42d4bdb609b3 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:49.818522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:49.819393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.819674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.819949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] PATH_INFO: `/v3/users/6d9bca11ecfb44d3add97a6d8475c49b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:49.833720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] RBAC: Authorizing `identity:get_user(user_id=6d9bca11ecfb44d3add97a6d8475c49b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:49.835186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:49.836815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 590/1182] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:49 2022] GET /identity/v3/users/6d9bca11ecfb44d3add97a6d8475c49b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:49.843982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:49.952386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc71957-36b4-44c9-8f60-38f8e52e172f None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:49.985896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:49.986540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:49.986853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:49.987129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:50.052766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:50.054149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:50.149186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 593/1183] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:50.155789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:50.255043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42b940-7193-43c5-b02e-71fbda2ae636 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:50.289112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:50.289961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:50.290244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:50.290521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] PATH_INFO: `/v3/projects/3944f2b93713444ebe390af6acb02871` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:50.291894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] RBAC: Authorizing `identity:get_project(project_id=3944f2b93713444ebe390af6acb02871)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:50.293376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc3bc0-f24b-4582-9469-56ab18e1a6da None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:50.295077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 591/1184] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:50 2022] GET /identity/v3/projects/3944f2b93713444ebe390af6acb02871 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:50.303970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:50.401685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15e5e-cbe4-4b93-9f1d-762bf9189c33 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:50.440091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:50.440759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:50.441093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:50.441371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:50.442192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3944f2b93713444ebe390af6acb02871, user.id=6d9bca11ecfb44d3add97a6d8475c49b) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:50.442509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:50.443952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dd2da-2a85-4e58-b58c-d83839656c66 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:50.449315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 594/1185] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:50 2022] GET /identity/v3/role_assignments?user.id=6d9bca11ecfb44d3add97a6d8475c49b&scope.project.id=3944f2b93713444ebe390af6acb02871&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:52:52.687295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716383d-6f9c-4355-a7d4-32368e3a824d None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:52.687945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716383d-6f9c-4355-a7d4-32368e3a824d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:52.687945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716383d-6f9c-4355-a7d4-32368e3a824d None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:52.689622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 592/1186] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:52.696276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:52.696962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:52.697140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:52.724184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:52.725381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:52.798292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 595/1187] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:52:52.827798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716383d-6f9c-4355-a7d4-32368e3a824d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:52.933347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716383d-6f9c-4355-a7d4-32368e3a824d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:52.966540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:52.967482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:52.967764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:52.968030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:52.978450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:52.985270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:52.986427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 593/1188] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:52.992965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:53.099703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1de0c-065a-4528-bdae-eac5738973ff None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:53.133567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:53.134233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:53.134494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:53.134833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:53.135580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:53.135887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:53.137274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:53.145527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 596/1189] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:53.155118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:53.259566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2724-ca18-42d0-8809-ebbc13be5b88 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:53.293116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:53.293973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:53.294254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:53.294528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] PATH_INFO: `/v3/users/6d9bca11ecfb44d3add97a6d8475c49b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:53.295850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] RBAC: Authorizing `identity:get_user(user_id=6d9bca11ecfb44d3add97a6d8475c49b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:53.297276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:53.298908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 594/1190] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:53 2022] GET /identity/v3/users/6d9bca11ecfb44d3add97a6d8475c49b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:53.305131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:53.415394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a096a4-9aa0-42bc-81ab-b5fc47714e43 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:53.450503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:53.451383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:53.451669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:53.451944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] PATH_INFO: `/v3/projects/3944f2b93713444ebe390af6acb02871` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:53.453178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] RBAC: Authorizing `identity:get_project(project_id=3944f2b93713444ebe390af6acb02871)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:53.454620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0ff74-4938-4700-86a1-f30bea5363fe None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:53.456307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 597/1191] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:53 2022] GET /identity/v3/projects/3944f2b93713444ebe390af6acb02871 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:53.465183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:53.562431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98651c-6d9a-4394-8815-853496b64b4d None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:53.595701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:53.596587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:53.596883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:53.597184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] PATH_INFO: `/v3/projects/3944f2b93713444ebe390af6acb02871/users/6d9bca11ecfb44d3add97a6d8475c49b/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:53.599386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] RBAC: Authorizing `identity:create_grant(project_id=3944f2b93713444ebe390af6acb02871, user_id=6d9bca11ecfb44d3add97a6d8475c49b, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:53.600832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0fc4a-d120-42d1-a02c-06abb9181104 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:53.618881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 595/1192] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:52:53 2022] PUT /identity/v3/projects/3944f2b93713444ebe390af6acb02871/users/6d9bca11ecfb44d3add97a6d8475c49b/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:52:55.845541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8df7c-d8e6-467f-a2d2-052ad89b7dab None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:55.846336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8df7c-d8e6-467f-a2d2-052ad89b7dab None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:55.846336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8df7c-d8e6-467f-a2d2-052ad89b7dab None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:55.848417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 598/1193] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:52:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:52:55.854012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:55.854453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:55.854542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:55.872940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:52:55.874137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:52:55.942319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 596/1194] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:52:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:52:55.965569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8df7c-d8e6-467f-a2d2-052ad89b7dab None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:56.069665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8df7c-d8e6-467f-a2d2-052ad89b7dab None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:56.115852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:56.116928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:56.117359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:56.117796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:56.135530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:52:56.145943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:52:56.147161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 599/1195] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:52:56.153645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:56.254973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b676cf-82ab-4c30-9bc2-d52dba90383b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:56.289320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:56.289971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:56.290250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:56.290528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:56.291303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:56.291615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:56.292987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:56.300849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 597/1196] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:56.306531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:56.403975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35c7aa-f712-4a9b-8316-e1e17c7aa122 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:56.436916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:56.437763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:56.438046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:56.438320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] PATH_INFO: `/v3/users/6d9bca11ecfb44d3add97a6d8475c49b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:56.439555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] RBAC: Authorizing `identity:get_user(user_id=6d9bca11ecfb44d3add97a6d8475c49b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:56.441095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:56.442682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 600/1197] 10.222.0.46 () {56 vars in 1177 bytes} [Fri Apr 1 09:52:56 2022] GET /identity/v3/users/6d9bca11ecfb44d3add97a6d8475c49b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:56.448953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:56.550570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f032d17-f7c6-4ec9-b227-a5dea4f7e63c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:56.584160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:56.584800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:56.585071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:56.585332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:56.658687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:56.660078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:56.760353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 598/1198] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:52:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:52:56.766592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:56.867967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa71cf-c7d4-4603-9135-5d792269f38a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:56.901792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:56.902995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:56.903282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:56.903559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] PATH_INFO: `/v3/projects/3944f2b93713444ebe390af6acb02871` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:56.904866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=3944f2b93713444ebe390af6acb02871)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:56.906297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71b6c8-2f8a-4eeb-88b4-d7f96102d2f4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:56.908010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 601/1199] 10.222.0.46 () {56 vars in 1186 bytes} [Fri Apr 1 09:52:56 2022] GET /identity/v3/projects/3944f2b93713444ebe390af6acb02871 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:52:56.915160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:52:57.029461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f40e13-bc5f-43c8-865d-5a74c9c8444e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:52:57.066046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:52:57.066694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:52:57.066990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:52:57.067283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:52:57.068094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3944f2b93713444ebe390af6acb02871, user.id=6d9bca11ecfb44d3add97a6d8475c49b) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:52:57.068409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:52:57.069845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23cfb9-f3eb-4a27-aa23-143ee559752d None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:52:57.075522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 599/1200] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:52:56 2022] GET /identity/v3/role_assignments?user.id=6d9bca11ecfb44d3add97a6d8475c49b&scope.project.id=3944f2b93713444ebe390af6acb02871&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:53:58.090563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f978552-9da1-46a6-94b2-33b0d5695550 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:53:58.091224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f978552-9da1-46a6-94b2-33b0d5695550 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:53:58.091224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f978552-9da1-46a6-94b2-33b0d5695550 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:53:58.093236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 602/1201] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:53:58.100762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:53:58.100762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:53:58.100762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:53:58.117682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:53:58.119496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:53:58.195261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 600/1202] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:53:58.225712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f978552-9da1-46a6-94b2-33b0d5695550 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:53:58.338663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f978552-9da1-46a6-94b2-33b0d5695550 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:53:58.374129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:53:58.374927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:53:58.375216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:53:58.375487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:53:58.386764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:53:58.388465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:53:58.409688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:53:58.416363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 603/1203] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:53:58.418454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:53:58.550282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239b89-162f-4ac4-adaf-db8d848c981e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:53:58.587663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:53:58.588346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:53:58.588647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:53:58.589191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:53:58.589642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:53:58.589999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:53:58.591438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6e60d-c431-412b-b61c-8ced436d5e83 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:53:58.603668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 601/1204] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:53:58.610602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:53:58.728763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dffc6-db06-4af5-be98-9d7930553968 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:53:58.768082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:53:58.768735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:53:58.769015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:53:58.769298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:53:58.770086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:53:58.771649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99469d-1d32-4f99-84a9-52e464260fb2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:53:58.794873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 604/1205] 10.222.0.46 () {60 vars in 1132 bytes} [Fri Apr 1 09:53:58 2022] POST /identity/v3/users => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 09:54:01.365679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75cc0-5441-432f-ac7f-9bb7ed2839c0 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:01.366235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75cc0-5441-432f-ac7f-9bb7ed2839c0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:01.366325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b75cc0-5441-432f-ac7f-9bb7ed2839c0 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:01.368535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 602/1206] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:01.374274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:01.374816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:01.374904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:01.392459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:01.394638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:01.475974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 605/1207] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:01.500051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b75cc0-5441-432f-ac7f-9bb7ed2839c0 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:01.614896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b75cc0-5441-432f-ac7f-9bb7ed2839c0 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:01.657370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:01.658229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:01.658593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:01.658878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:01.671022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:01.679252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:54:01.680612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 603/1208] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:54:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:01.686619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:01.788525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd203-7b56-4f3f-8380-b290fa6e9f43 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:01.826467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:01.827169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:01.827554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:01.827884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:01.828518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:01.828829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:01.830286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:01.840211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 606/1209] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:54:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:01.846419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:01.965846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c3d9a-5a76-4a29-b297-b32e6f36a491 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:02.005634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:02.006687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:02.006975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:02.007246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:02.020194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:02.021647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:02.042779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:02.046405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 604/1210] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:02.049946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:02.149714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cf040-7af3-417a-a83f-3bf15cd4d7a2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:02.187821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:02.188873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:02.189158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:02.189393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:02.190201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:02.190511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:02.192041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:02.204623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 607/1211] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:02.210273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:02.318604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bc261-699d-4556-ab1e-13507cb11910 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:02.352688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:02.353552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:02.353836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:02.354113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:02.362249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:02.363882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:02.378504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:02.380629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 605/1212] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:02.386030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:02.487918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdff8c-5b04-4c32-b8a4-d9337a9a6115 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:02.523941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:02.524734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:02.525022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:02.525628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:02.526498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:02.526913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:02.528366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:02.547467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 608/1213] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:02.556592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:02.657213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175ddae-534d-4cb0-944c-796930f9a59b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:02.691558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:02.692271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:02.692555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:02.692832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:02.762288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:02.764169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:02.880665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 606/1214] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:54:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:54:02.880907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:02.981448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa5d3e-79a9-464f-99c2-cca2c9d6ec12 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:03.017230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:03.018063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:03.018351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:03.018617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:03.028902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:03.030351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:03.047466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:03.048929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 609/1215] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:03.056716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:03.155346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062493bc-a1c8-4e15-ab28-c29609a4d842 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:03.188669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:03.189403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:03.189618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:03.189922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:03.190614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:03.190942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:03.192426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:03.204479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 607/1216] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:03.210313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:03.316381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbca6a-ad94-40d8-a984-3a96c9f6d0cd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:03.352385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:03.353364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:03.353646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:03.353994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:03.361190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:03.362639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:03.379472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:03.380966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 610/1217] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:03.387197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:03.500777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219c10e-eb78-4d2c-8e57-bb57cfcb5cec None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:03.539182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:03.540025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:03.540295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:03.540567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:03.541374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:03.541681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:03.543151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7967e-0deb-4a8c-a6f3-11cad7cc5995 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:03.556822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 608/1218] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:03.563106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:03.685365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dba5e9-8171-4d9c-8744-a7a8d2a916ca None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:03.722360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:03.723174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:03.723459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:03.723732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:03.724623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=31d9c1639edd4e40a16ad8809dc20353) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:03.724934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:03.726613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a3e43-454f-48f8-a120-b86d19ffef24 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:03.732730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 611/1219] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:54:03 2022] GET /identity/v3/role_assignments?user.id=31d9c1639edd4e40a16ad8809dc20353&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:06.059234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4b58-dd4f-4c95-8d1a-8302a0734390 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.059234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4b58-dd4f-4c95-8d1a-8302a0734390 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.059234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e4b58-dd4f-4c95-8d1a-8302a0734390 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.062022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 609/1220] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:54:06.068849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.069305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.069643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.089355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:06.090608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:06.166339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 612/1221] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:06.189838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4b58-dd4f-4c95-8d1a-8302a0734390 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:06.302737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e4b58-dd4f-4c95-8d1a-8302a0734390 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:06.338479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:06.339303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.339635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.339914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.351046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:06.358305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:54:06.359542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 610/1222] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:54:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:06.366124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:06.476808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2f1d3-9dea-49d7-a0f1-e31ced1e09b1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:06.513062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:06.513739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.514021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.514296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.515088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:06.515415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:06.516913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:06.526238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 613/1223] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:54:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:06.532314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:06.637621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffd4be-1b0b-4fd6-86ba-275e64f5859c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:06.675277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:06.676136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.676483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.676820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.688825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:06.690463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:06.709445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:06.711060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 611/1224] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:06.717034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:06.830341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d758e4-62c3-4053-8e01-ac32446e8e83 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:06.864105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:06.865046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:06.865386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:06.865688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:06.866524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:06.866859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:06.868434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:06.881835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 614/1225] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:06.888501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:06.990505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d2ba0-f099-4671-a6e3-5aa6f70f337c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.025875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.026837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.027112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.027386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.036761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.038366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.052599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:07.053776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 612/1226] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:07.059891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:07.164550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f19f7-8d44-41fb-8921-553b76171cdf None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.203578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.204358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.204703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.205096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.206214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:07.206694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.208420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.226528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 615/1227] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:07.232695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:07.336526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b2e81-3a25-4539-b72b-886b66d72157 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.369609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.370403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.370707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.370991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.381507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.382989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.399913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:07.401483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 613/1228] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:54:07.407586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:07.509635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaad44-3f3a-4463-b743-1cc2f81074bb None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.544758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.545456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.545767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.546044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.546916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:07.547260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.548797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.561222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 616/1229] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:07.567092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:07.675376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5411f-510f-4e96-8c38-6593a76773e5 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.710467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.711594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.712046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.712489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.719967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.721546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.736086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:07.737544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 614/1230] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:07.743475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:07.848661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62e7ba-ef6f-46af-b96e-d15a5ba30bcb None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:07.883312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:07.883982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:07.884269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:07.884555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:07.885344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:07.885654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:07.887141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f011c-9d3e-4cbf-863c-8057daecdbf8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:07.899663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 617/1231] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:07.906574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:08.012205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896ceb-0fbe-4f87-8f32-3405c731cb0c None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:08.046736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:08.047634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:08.047917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:08.048193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/31d9c1639edd4e40a16ad8809dc20353/roles/4be75705da78435d9d5d9aaff48f2907` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:08.063152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=31d9c1639edd4e40a16ad8809dc20353, role_id=4be75705da78435d9d5d9aaff48f2907)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:08.064663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97205d94-9bcc-41a5-b718-69a67b926ebb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:08.077689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 615/1232] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:54:07 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/31d9c1639edd4e40a16ad8809dc20353/roles/4be75705da78435d9d5d9aaff48f2907 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 09:54:10.469564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4797-ec35-4b2d-833c-314d974e5f12 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:10.470186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4797-ec35-4b2d-833c-314d974e5f12 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:10.470186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f4797-ec35-4b2d-833c-314d974e5f12 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:10.471906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 618/1233] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:10.478397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:10.478894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:10.479042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:10.498193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:10.499414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:10.569572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 616/1234] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:10.598117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4797-ec35-4b2d-833c-314d974e5f12 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:10.715716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f4797-ec35-4b2d-833c-314d974e5f12 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:10.751967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:10.752697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:10.752981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:10.753253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:10.763099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:10.770099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 01 09:54:10.771360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 619/1235] 10.222.0.46 () {56 vars in 1102 bytes} [Fri Apr 1 09:54:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:10.777684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:10.880034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af22c2-f532-4352-be03-eadd66c0a05e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:10.913837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:10.914483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:10.914811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:10.915089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:10.915840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] RBAC: Adding query filter params (name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:10.916145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:10.917578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:10.926083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 617/1236] 10.222.0.46 () {56 vars in 1103 bytes} [Fri Apr 1 09:54:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:10.931866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:11.034024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1bc4-4dfe-4f67-b329-bb2d41edf97b None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:11.070587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:11.071483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:11.071773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:11.072070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:11.084075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:11.085553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:11.102439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:11.103698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 620/1237] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:11.109546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:11.220966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eab2c7-6f0b-4c58-8482-58ce38a03c02 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:11.260745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:11.261529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:11.261968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:11.262246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:11.263025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:11.263333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:11.264878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:11.280162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 618/1238] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:11.285738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:11.389619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d2e3a-bec0-4440-a359-3d8bd25dbf6e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:11.427350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:11.428245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:11.428609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:11.429252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:11.437328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:11.438823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:11.452122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:11.453306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 621/1239] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:54:11.459190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:11.566352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494516-7836-4df9-b2a9-4b5c1fd52784 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:11.602303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:11.603020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:11.603384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:11.603568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:11.604384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:11.604677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:11.606117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:11.624099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 619/1240] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:11.630059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:11.751499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dc5fe-ac58-4eb1-9c02-fdb3ce5ccd89 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:11.788956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:11.789598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:11.789881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:11.790153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:11.863523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:11.864939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:11.971263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 622/1241] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:54:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 01 09:54:11.977488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:12.085020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d824b1-d9f2-4af8-93ff-7ed5586585cf None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:12.120281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:12.121003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:12.121291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:12.121571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:12.133475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:12.135039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:12.153431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:12.154725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 620/1242] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:12.160836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:12.265079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d73db-23a6-4c49-8bfd-d67972bd38c4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:12.300232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:12.300950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:12.301269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:12.301545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:12.302258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:12.302566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:12.303988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:12.316380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 623/1243] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:12.322237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:12.432669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6598e66-2a9d-4eca-8ded-951c32eb8762 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:12.470914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:12.471731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:12.471989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:12.472263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:12.480243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:12.481830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:12.496888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:12.498583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 621/1244] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 01 09:54:12.504430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:12.607564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda81c-93dc-414f-a1cd-2fd1721c5597 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:12.649383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:12.650497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:12.650608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:12.651054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:12.651746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:12.652153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:12.653491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791e0ee-54fc-4551-9ca9-fcf69f3d9356 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:12.666914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 624/1245] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:12.673410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:12.786614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532c1b-14ab-419f-b3e3-53a6086b54bb None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:12.823605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:12.824530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:12.824858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:12.825137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:12.826150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] RBAC: Adding query filter params (role.id=4be75705da78435d9d5d9aaff48f2907, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=31d9c1639edd4e40a16ad8809dc20353) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:12.826458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:12.828235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780d2aa-daae-4cf0-aa45-33e39dd79933 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:12.835290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 622/1246] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:54:12 2022] GET /identity/v3/role_assignments?user.id=31d9c1639edd4e40a16ad8809dc20353&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=4be75705da78435d9d5d9aaff48f2907 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:15.505286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968fca-6511-42de-a71e-b9769f492b0b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:15.505889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968fca-6511-42de-a71e-b9769f492b0b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:15.506010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968fca-6511-42de-a71e-b9769f492b0b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:15.507959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 625/1247] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:54:15.513681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:15.514106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:15.514259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:15.532884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:15.534132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:15.606690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 623/1248] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:15.631145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968fca-6511-42de-a71e-b9769f492b0b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:15.746358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968fca-6511-42de-a71e-b9769f492b0b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:15.782803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:15.783624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:15.783909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:15.784180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:15.794687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:15.801608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:54:15.802848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 626/1249] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:15.809155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:15.915073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf820bd-99e7-4fac-ba59-7adcfb854d13 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:15.950295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:15.950964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:15.951251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:15.951553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:15.952276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:15.952596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:15.953976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:15.961890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 624/1250] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:15.967859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:16.071021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a93f7-2693-4cd8-a05e-70716ad29a70 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:16.105014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:16.105847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:16.106150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:16.106402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:16.119066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:16.120757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:16.138831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:16.140159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 627/1251] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:16.146126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:16.247279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fa341-c473-4af2-9b90-aed6967eaa83 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:16.282484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:16.283213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:16.283498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:16.283749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:16.284474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:16.284775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:16.286158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:16.298495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 625/1252] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:16.304493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:16.412350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9457-8891-492d-bcaa-9dba022ebcc4 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:16.449176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:16.450234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:16.450519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:16.450850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:16.459345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:16.460828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:16.474463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:16.475727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 628/1253] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:16.482267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:16.585778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978a5f7-1b85-49d9-93aa-022a720d9f33 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:16.620297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:16.621115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:16.621473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:16.621750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:16.622692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:16.623067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:16.624715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:16.650141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 626/1254] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:16.651417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:16.763697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d006992-6ef0-4986-9a99-1cc8f38f7c5e None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:16.798549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:16.799277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:16.799558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:16.799835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:16.872300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:16.873781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:16.979852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 629/1255] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:54:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:54:16.985952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:17.096283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231067b2-768f-4877-bfe9-2a2d777c2d0b None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:17.132580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535389fd-417a-4589-b644-7266913c33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:17.133391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535389fd-417a-4589-b644-7266913c33ae None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:17.133672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535389fd-417a-4589-b644-7266913c33ae None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:17.133946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535389fd-417a-4589-b644-7266913c33ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:17.144917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535389fd-417a-4589-b644-7266913c33ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:17.146512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535389fd-417a-4589-b644-7266913c33ae None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:17.164659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-535389fd-417a-4589-b644-7266913c33ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:17.165932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 627/1256] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:17.172082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:17.278159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5e26-f48e-444c-adca-35454db772cc None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:17.311899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:17.312562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:17.312816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:17.313086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:17.313796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:17.314095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:17.315584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:17.326838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 630/1257] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:17.332630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535389fd-417a-4589-b644-7266913c33ae None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:17.431125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535389fd-417a-4589-b644-7266913c33ae None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:17.463488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:17.464277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:17.464559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:17.464834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:17.476631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:17.478099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:17.491363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:17.492586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 628/1258] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:17.498767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:17.595909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee31712-978e-478c-87f0-f917e07477a0 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:17.629633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:17.630302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:17.630587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:17.630898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:17.631901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:17.632211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:17.633901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d5cd6c-0a59-4920-ae9c-783e6fd94285 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:17.647763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 631/1259] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:17.655042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:17.757690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290000-1eab-4368-a94a-b7b647f29761 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:17.792337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:17.792983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:17.793264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:17.793539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:17.794352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=31d9c1639edd4e40a16ad8809dc20353) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:17.794668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:17.796117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6329d-5f01-4252-bdf1-8657528b1759 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:17.801511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 629/1260] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:54:17 2022] GET /identity/v3/role_assignments?user.id=31d9c1639edd4e40a16ad8809dc20353&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:20.042569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f568a2b-791b-441e-bc93-5493f68bfa85 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.043512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f568a2b-791b-441e-bc93-5493f68bfa85 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.043512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f568a2b-791b-441e-bc93-5493f68bfa85 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.046415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 632/1261] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:20.052786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.053235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.053356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.080370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:20.081908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:20.147449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 630/1262] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:20.171293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f568a2b-791b-441e-bc93-5493f68bfa85 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:20.286877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f568a2b-791b-441e-bc93-5493f68bfa85 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:20.320835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:20.321542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.321825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.322099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.332598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:20.339540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:54:20.340699 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 633/1263] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:20.346891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:20.452977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae418bff-9531-48e8-9aed-15c6d6c725a4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:20.489853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:20.490506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.490816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.491093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.492222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:20.492222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:20.493494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:20.501357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 631/1264] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:20.507709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:20.609059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922801-9693-40da-adc5-8f985c118ba1 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:20.645485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:20.646404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.646760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.647073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.658943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:20.660743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:20.678570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:20.679914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 634/1265] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:20.686759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:20.785292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697da17-c7aa-45ad-b229-76865ddf228f None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:20.820192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:20.820842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.821130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.821404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.822115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:20.822418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:20.823812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:20.835464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 632/1266] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:20.841787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:20.946469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674a992-c32c-4b90-bee8-fea40e2c0150 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:20.979269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:20.980053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:20.980331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:20.980600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:20.988056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:20.989475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.002862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:21.004075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 635/1267] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:21.010191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.123152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c3539-de7b-46c5-a617-c0df1eca2628 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:21.157541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:21.158214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:21.158490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:21.158775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:21.159683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:21.159960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:21.161429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.178560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 633/1268] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:21.184479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.285856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d2fcc-27d1-442f-b5aa-922893ab9745 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:21.318347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:21.319161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:21.319440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:21.319709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:21.329726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:21.331255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.346821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:21.347973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 636/1269] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:21.354520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.471843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864576c0-3d27-4733-a043-83302e5bfe5e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:21.508985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:21.509644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:21.509923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:21.510199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:21.510934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:21.511236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:21.512593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.523617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 634/1270] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:21.530099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.639551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458988c-347f-4c56-96ab-c53b272df130 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:21.676478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:21.677276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:21.677571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:21.677844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:21.684446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:21.685897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.699156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:21.700318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 637/1271] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:21.709150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.807133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d49c18-91b4-49a2-9979-7c867781e78e None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:21.840350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:21.840998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:21.841278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:21.841552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:21.842331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:21.842639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:21.844093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a30bb-d062-419d-a9f8-b4abf24c2a0a None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:21.856720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 635/1272] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:21.862946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:21.989446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0910c-67d6-42ac-a371-ce83110a8f5d None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:22.025150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:22.026041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:22.026323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:22.026596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] PATH_INFO: `/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/31d9c1639edd4e40a16ad8809dc20353/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:22.028671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a1542346e474cd0a916b786b8ee8623, user_id=31d9c1639edd4e40a16ad8809dc20353, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:22.030117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1403c10-1985-43fc-a615-333a1753219a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:22.046028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 638/1273] 10.222.0.46 () {58 vars in 1439 bytes} [Fri Apr 1 09:54:21 2022] PUT /identity/v3/projects/3a1542346e474cd0a916b786b8ee8623/users/31d9c1639edd4e40a16ad8809dc20353/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 09:54:24.296356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d79e-326b-487e-b579-68af7c220578 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:24.297213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d79e-326b-487e-b579-68af7c220578 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:24.297213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791d79e-326b-487e-b579-68af7c220578 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:24.300167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 636/1274] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:24.305511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:24.305944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:24.306047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:24.323198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:24.324366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:24.395660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 639/1275] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:24.419710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d79e-326b-487e-b579-68af7c220578 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:24.523478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791d79e-326b-487e-b579-68af7c220578 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:24.560617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:24.561358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:24.561639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:24.561918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:24.573510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 01 09:54:24.580441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 01 09:54:24.581751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 637/1276] 10.222.0.46 () {56 vars in 1096 bytes} [Fri Apr 1 09:54:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:24.588402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:24.697992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d87d-20d3-434a-8647-e893cc5bf8d1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:24.732319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:24.732984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:24.733266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:24.733542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:24.734285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:24.734592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:24.735987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:24.744000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 640/1277] 10.222.0.46 () {56 vars in 1099 bytes} [Fri Apr 1 09:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:24.753204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:24.868145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015639-0398-4439-9521-f8387b7ea665 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:24.905838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:24.906620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:24.906934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:24.907214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:24.917416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:24.918888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:24.936681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:24.937825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 638/1278] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:24.944711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:25.054432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68544533-e9fc-4fd9-9193-a831771608cd None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:25.087896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:25.088556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:25.088850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:25.089129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:25.089868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:25.090185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:25.091614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:25.103223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 641/1279] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:25.111816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:25.211206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89cbc-822c-4496-83da-29b2327b58f6 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:25.244269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:25.245059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:25.245342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:25.245614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:25.253744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:25.255226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:25.268880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 01 09:54:25.270048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 639/1280] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:25.280246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:25.382869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93705f77-0590-41fa-b85f-c0d71c14da1c None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:25.417152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:25.417821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:25.418115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:25.418393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:25.419272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:25.419579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:25.421030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:25.437858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 642/1281] 10.222.0.46 () {56 vars in 1143 bytes} [Fri Apr 1 09:54:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:25.444212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:25.548680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fb723-7c19-423d-ab8b-e0a75a003230 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:25.582077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:25.582754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:25.583036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:25.583318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:25.655918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:25.657371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:25.755278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 640/1282] 10.222.0.46 () {58 vars in 1282 bytes} [Fri Apr 1 09:54:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 01 09:54:25.764127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:25.863131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372a3a-4ab1-4e80-be54-bec0f253cc5a None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:25.896505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:25.897277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:25.897553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:25.897825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:25.908145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:25.909609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:25.926915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 01 09:54:25.928071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 643/1283] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:25.934381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:26.038041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec64a-cde7-4667-a7fc-847758613c28 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:26.073815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:26.074477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:26.074788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:26.075073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:26.075801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:26.076110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:26.077501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:26.089108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 641/1284] 10.222.0.46 () {56 vars in 1109 bytes} [Fri Apr 1 09:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:26.097676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:26.203288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fc6e6-402e-4a6e-9ab9-466d639d3e17 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:26.236740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:26.237583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:26.237868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:26.238121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:26.244783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:26.246226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:26.259157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING keystone.server.flask.application [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 01 09:54:26.260317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 644/1285] 10.222.0.46 () {56 vars in 1111 bytes} [Fri Apr 1 09:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:26.269136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:26.368305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164ae10-0241-46cc-9801-55df61b784dd None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:26.402180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:26.402866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:26.403153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:26.403430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:26.404217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:26.404531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:26.405963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c661e37-6f92-4cf4-9b4e-6347099f8965 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:26.418014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 642/1286] 10.222.0.46 () {56 vars in 1148 bytes} [Fri Apr 1 09:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:26.424919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:26.522824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0fcb6-3afa-4ec3-8701-acc6580a62f2 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:26.556118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:26.556764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:26.557050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:26.557321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:26.558150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] RBAC: Adding query filter params (role.id=f9d36af787804f248e9bea8324501c2a, scope.project.id=3a1542346e474cd0a916b786b8ee8623, user.id=31d9c1639edd4e40a16ad8809dc20353) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:26.558462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:26.559947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c93c45-b432-4718-84aa-8a91fa4921da None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:26.565788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 645/1287] 10.222.0.46 () {56 vars in 1374 bytes} [Fri Apr 1 09:54:26 2022] GET /identity/v3/role_assignments?user.id=31d9c1639edd4e40a16ad8809dc20353&scope.project.id=3a1542346e474cd0a916b786b8ee8623&role.id=f9d36af787804f248e9bea8324501c2a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:28.826097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8fd83-98e5-4db2-9fa9-498a86865889 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:28.826964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8fd83-98e5-4db2-9fa9-498a86865889 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:28.826964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8fd83-98e5-4db2-9fa9-498a86865889 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:28.829730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 643/1288] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:28.835155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:28.835595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:28.835684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:28.855094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:28.856298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:28.921997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 646/1289] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:28.957246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8fd83-98e5-4db2-9fa9-498a86865889 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:29.071447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8fd83-98e5-4db2-9fa9-498a86865889 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:29.104749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:29.105478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:29.105813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:29.106001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:29.106683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:29.108108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:29.119269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 01 09:54:29.120425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 644/1290] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:54:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:29.129590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:29.232883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca9c8e-72f8-4cef-94f4-49546661f749 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:29.268070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:29.268713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:29.268991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:29.269257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:29.269951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:29.270248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:29.271615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a41e4f-d710-4b6c-8dba-0fd68af44dd2 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:29.276649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 647/1291] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Apr 1 09:54:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 09:54:29.282423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:29.388965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f4da1-5770-4bb3-b329-f9e2adb10663 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:29.424737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:29.425381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:29.425660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:29.425931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] PATH_INFO: `/v3/services` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:29.426631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:29.426964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:29.428335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b71cb0-82e5-4739-b174-92931d668224 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:29.432805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 645/1292] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Apr 1 09:54:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:31.664627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a8a2-b869-4357-99c4-90bcf5b22e00 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:31.665170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a8a2-b869-4357-99c4-90bcf5b22e00 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:31.665170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299a8a2-b869-4357-99c4-90bcf5b22e00 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:31.666968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 648/1293] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:31.672795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465594e5-c521-4b0d-9220-490f7188ed9e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:31.673249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465594e5-c521-4b0d-9220-490f7188ed9e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:31.673470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465594e5-c521-4b0d-9220-490f7188ed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:31.692278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-465594e5-c521-4b0d-9220-490f7188ed9e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:31.693468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-465594e5-c521-4b0d-9220-490f7188ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:31.759855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 646/1294] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 01 09:54:31.783114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299a8a2-b869-4357-99c4-90bcf5b22e00 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:31.896984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299a8a2-b869-4357-99c4-90bcf5b22e00 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:31.932393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:31.933052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:31.933344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:31.933620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:31.934352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:31.935833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38e2df-5c78-471b-923b-fa415a5894dd None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:31.951944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 649/1295] 10.222.0.46 () {60 vars in 1141 bytes} [Fri Apr 1 09:54:31 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:54:34.177059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00260ecf-85cc-4edd-8493-fb25917238cc None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.177955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00260ecf-85cc-4edd-8493-fb25917238cc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.177955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00260ecf-85cc-4edd-8493-fb25917238cc None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.180828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 647/1296] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:34.187101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.187524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.187712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.211313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:34.212504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:34.286333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 650/1297] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:34.313916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00260ecf-85cc-4edd-8493-fb25917238cc None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:34.422416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00260ecf-85cc-4edd-8493-fb25917238cc None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:34.456205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:34.456954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.457235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.457507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.458156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:34.459544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:34.470802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 01 09:54:34.472092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 648/1298] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:54:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:34.479141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:34.587824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a0498-95af-4cf7-bdc7-90d4a2e47661 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:34.621925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:34.622581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.622896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.623168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.623878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:34.624182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:34.625557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:34.631040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 651/1299] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Apr 1 09:54:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:34.640779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:34.744435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f1c2a-a025-421f-86ae-be1d72938486 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:34.778380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:34.779057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.779344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.779622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.780414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] RBAC: Adding query filter params (interface=public, service_id=7e645d5831754092b0c82b1480eb283f, region_id=RegionOne) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:34.780724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:34.782091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb49fa2-264d-46fa-a99b-1154ed126ba5 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:34.787397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 649/1300] 10.222.0.46 () {56 vars in 1251 bytes} [Fri Apr 1 09:54:34 2022] GET /identity/v3/endpoints?service_id=7e645d5831754092b0c82b1480eb283f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:34.793315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:34.890412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1eb9-13ff-4ac6-813d-dcb67461ceb8 None admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:34.924937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:34.925569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:34.925876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:34.926199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:34.926848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:34.928207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f2a30-e425-4ad1-aac1-461d850c0510 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:34.934947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 652/1301] 10.222.0.46 () {56 vars in 1087 bytes} [Fri Apr 1 09:54:34 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:54:37.190510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d6f4-a0e4-4c17-983a-e02eb45516b7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:37.191096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d6f4-a0e4-4c17-983a-e02eb45516b7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:37.191096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8d6f4-a0e4-4c17-983a-e02eb45516b7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:37.192895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 650/1302] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:54:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:54:37.199223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:37.199920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:37.200069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:37.220376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:54:37.221607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:54:37.290849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 653/1303] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:54:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 01 09:54:37.316996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8d6f4-a0e4-4c17-983a-e02eb45516b7 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:37.421852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8d6f4-a0e4-4c17-983a-e02eb45516b7 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:37.455294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:37.456066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:37.456351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:37.456628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:37.457282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:37.458693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:37.469722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING keystone.server.flask.application [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 01 09:54:37.470937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 651/1304] 10.222.0.46 () {56 vars in 1117 bytes} [Fri Apr 1 09:54:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 01 09:54:37.477351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:37.580906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbb525-f53b-46f5-b429-b325491dd7d1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:37.613777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:37.614364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:37.614703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:37.614943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] PATH_INFO: `/v3/services` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:37.615738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 09:54:37.616041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:37.617545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13c8d1-0c2d-44ed-ac8d-5b6c3e06b7d0 None admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:37.623597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 654/1305] 10.222.0.46 () {56 vars in 1116 bytes} [Fri Apr 1 09:54:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 09:54:37.630938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:54:37.736950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36a4-a1f1-4208-94d8-743451087fa2 None admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:54:37.772590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:54:37.773234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:54:37.773519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:54:37.773792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:54:37.774871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:54:37.776240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38fc7c-b67c-4b00-a6be-39af5d62f32c None admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:54:37.797138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 652/1306] 10.222.0.46 () {60 vars in 1144 bytes} [Fri Apr 1 09:54:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 09:55:41.459642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a6ce-8320-45fc-b086-ec5655dd6ecf None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:41.460572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a6ce-8320-45fc-b086-ec5655dd6ecf None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:41.460997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6a6ce-8320-45fc-b086-ec5655dd6ecf None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:41.467439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 655/1307] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:41.469137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33c9d-91bd-4e18-9093-985b6c30fffd None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:41.469579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33c9d-91bd-4e18-9093-985b6c30fffd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:41.469897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c33c9d-91bd-4e18-9093-985b6c30fffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:41.552502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-97c33c9d-91bd-4e18-9093-985b6c30fffd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:41.554140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-97c33c9d-91bd-4e18-9093-985b6c30fffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:41.684364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 653/1308] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:41.734325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:41.734991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:41.735426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:41.737343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 656/1309] 10.222.0.46 () {54 vars in 963 bytes} [Fri Apr 1 09:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:41.743565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d126c-4e24-492e-a364-85ec7a74639e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:41.744071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d126c-4e24-492e-a364-85ec7a74639e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:41.744543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d126c-4e24-492e-a364-85ec7a74639e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:41.897403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e15d126c-4e24-492e-a364-85ec7a74639e None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:41.898597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e15d126c-4e24-492e-a364-85ec7a74639e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:42.042082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 654/1310] 10.222.0.46 () {58 vars in 1060 bytes} [Fri Apr 1 09:55:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:42.050797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:42.052538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:42.216331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d827f-143b-4e11-979f-1320c62db60e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:42.291806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:42.292755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:42.293188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:42.293617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:42.295491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:42.410394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:42.412187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de00d2-2cf5-4eba-903d-cc97785563c3 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:42.433020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 657/1311] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:55:45.029353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4f72-4bd6-4a2a-a178-807d6c0ae272 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:45.030257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4f72-4bd6-4a2a-a178-807d6c0ae272 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:45.030795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc4f72-4bd6-4a2a-a178-807d6c0ae272 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:45.038253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b86b2-9546-4600-8569-79f39eab75b6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:45.038734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b86b2-9546-4600-8569-79f39eab75b6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:45.038835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b86b2-9546-4600-8569-79f39eab75b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:45.042095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 655/1312] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:45.120810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-640b86b2-9546-4600-8569-79f39eab75b6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:45.122312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-640b86b2-9546-4600-8569-79f39eab75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:45.217943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 658/1313] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 09:55:45.268063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:45.268329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:45.268611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:45.270414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 656/1314] 10.222.0.46 () {54 vars in 963 bytes} [Fri Apr 1 09:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:45.276688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e18-5b1f-4519-bccd-b2a3b66b8da1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:45.276976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e18-5b1f-4519-bccd-b2a3b66b8da1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:45.277250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b4e18-5b1f-4519-bccd-b2a3b66b8da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:45.353261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2d2b4e18-5b1f-4519-bccd-b2a3b66b8da1 None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:45.354474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2d2b4e18-5b1f-4519-bccd-b2a3b66b8da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:45.430685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 659/1315] 10.222.0.46 () {58 vars in 1060 bytes} [Fri Apr 1 09:55:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:45.439844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:45.441355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:45.547918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe143-84e5-4140-ae08-1a31771ac4e9 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:45.622250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:45.622958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:45.623246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:45.623585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:45.625334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:45.738440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:45.739934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2d867-4cd5-4433-9ef2-43665897ba79 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:45.758718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 657/1316] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:55:48.556513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:48.557370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:48.557370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:48.560374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 660/1317] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:48.569020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09193-634c-47b4-b30a-13c8939de42e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:48.569462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09193-634c-47b4-b30a-13c8939de42e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:48.569554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a09193-634c-47b4-b30a-13c8939de42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:48.647712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-74a09193-634c-47b4-b30a-13c8939de42e None None] MFA Rules not processed for user `caee3a5e3ad64991b0c7b600ebf4de14`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:48.649667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-74a09193-634c-47b4-b30a-13c8939de42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:48.748558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 658/1318] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:48.791938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:48.794265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:48.904403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb160b6-f470-4e7f-94cc-26cb7e0689d3 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:48.980214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:48.981469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:48.981772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:48.982045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:48.983777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:49.098915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:49.100279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ac54d-97bb-4290-adbf-fe58bb58e5b4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:49.118125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 661/1319] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:55:51.920374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:51.920943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:51.920943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:51.922994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 659/1320] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:51.929941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e20e7-349c-4d44-ade6-b3cc5ff6c8e6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:51.930727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e20e7-349c-4d44-ade6-b3cc5ff6c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:51.930881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e20e7-349c-4d44-ade6-b3cc5ff6c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:52.005546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-908e20e7-349c-4d44-ade6-b3cc5ff6c8e6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:52.006792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-908e20e7-349c-4d44-ade6-b3cc5ff6c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:52.101555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 662/1321] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:52.143288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:52.144828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:52.256229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fa849-0e69-473e-b989-e2f463d842b5 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:52.338106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:52.338812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:52.339090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:52.339359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:52.341029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:52.449538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:52.451027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c1d7c-009e-46c2-81b4-0f9875a9f5cb service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:52.468791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 660/1322] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:55:55.611470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:55.612000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:55.612000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:55.613798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 663/1323] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:55.619069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d858-de39-4700-a9d2-68ef7738e32f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:55.619511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d858-de39-4700-a9d2-68ef7738e32f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:55.619603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d858-de39-4700-a9d2-68ef7738e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:55.684981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f088d858-de39-4700-a9d2-68ef7738e32f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:55.686169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f088d858-de39-4700-a9d2-68ef7738e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:55.780779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 661/1324] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:55:55.816115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:55.817688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:55.922746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f290e1-d12e-4389-aeae-12d0dfab7fae None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:55.994683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:55.995362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:55.995645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:55.995930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:55.997559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:56.104695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:56.106052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdbb46-1ef5-48a7-a5d1-161af5a0a5c8 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:56.123879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 664/1325] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:55:58.448022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:58.448583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:58.448583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:58.450422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 662/1326] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:55:58.456227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e4b5-fad6-4c7e-a570-f9d580962981 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:58.456694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e4b5-fad6-4c7e-a570-f9d580962981 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:58.456788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3e4b5-fad6-4c7e-a570-f9d580962981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:58.521556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c8e3e4b5-fad6-4c7e-a570-f9d580962981 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:55:58.522777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c8e3e4b5-fad6-4c7e-a570-f9d580962981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:58.618517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 665/1327] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 09:55:58.655444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:55:58.657025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:58.760883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6d471-552b-4b1d-988c-1d5045861303 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:55:58.832509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:55:58.833162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:55:58.833443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:55:58.833717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:55:58.835365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:55:58.940427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:55:58.941860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676515ec-308b-44da-a843-f0e523c2f9b8 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:55:58.959563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 663/1328] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:56:01.282447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:01.283029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:01.283029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:01.284890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 666/1329] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:01.290289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d174-0191-4d77-8e47-13ad790d85c1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:01.290704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d174-0191-4d77-8e47-13ad790d85c1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:01.290928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d174-0191-4d77-8e47-13ad790d85c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:01.360871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-7ea7d174-0191-4d77-8e47-13ad790d85c1 None None] MFA Rules not processed for user `caee3a5e3ad64991b0c7b600ebf4de14`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:01.362162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7ea7d174-0191-4d77-8e47-13ad790d85c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:01.464074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 664/1330] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:01.501885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:01.503469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:01.609694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821245b-8d27-40fd-8a78-5eb8a38f89b4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:01.681834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:01.682479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:01.682792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:01.683062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:01.684676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:01.796478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:01.797965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366abcb-4ad4-4dba-9f44-dab58258c69f service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:01.816430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 667/1331] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:04.313330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:04.313896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:04.313896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:04.316045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 665/1332] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:04.321710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b970-45b7-43bc-9b89-826c0c389655 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:04.322139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b970-45b7-43bc-9b89-826c0c389655 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:04.322270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b970-45b7-43bc-9b89-826c0c389655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:04.389377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1386b970-45b7-43bc-9b89-826c0c389655 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:04.390819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1386b970-45b7-43bc-9b89-826c0c389655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:04.497483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 668/1333] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:04.534205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:04.535762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:04.642562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9a307-bdb9-49b3-8a57-b05495e9807d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:04.716851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:04.717498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:04.717816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:04.718091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:04.719803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:04.829464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:04.830861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660488f5-f0ce-45a8-b997-a90f92aeefff service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:04.848907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 666/1334] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:07.169629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:07.170535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:07.170535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:07.173365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 669/1335] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:07.179739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3589a-6e81-414f-b254-b9b0b23ff860 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:07.180459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3589a-6e81-414f-b254-b9b0b23ff860 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:07.180604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3589a-6e81-414f-b254-b9b0b23ff860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:07.250372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2cd3589a-6e81-414f-b254-b9b0b23ff860 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:07.251630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2cd3589a-6e81-414f-b254-b9b0b23ff860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:07.347775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 667/1336] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:07.390279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:07.391854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:07.505043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dfc67-6c4c-4d71-880a-e6b6a89452b2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:07.589794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:07.590449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:07.590736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:07.591023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:07.592656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:07.700035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:07.701481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47554c8-c23f-420c-81cb-7ee746e7b19b service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:07.719399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 670/1337] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:56:10.303099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:10.303935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:10.304077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:10.306999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 668/1338] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:10.312866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123eb8-4f04-4f34-ae90-b4b4cb0434d4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:10.313288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123eb8-4f04-4f34-ae90-b4b4cb0434d4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:10.313404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d123eb8-4f04-4f34-ae90-b4b4cb0434d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:10.378375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8d123eb8-4f04-4f34-ae90-b4b4cb0434d4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:10.379673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8d123eb8-4f04-4f34-ae90-b4b4cb0434d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:10.474885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 671/1339] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:10.511843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:10.513387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:10.629420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089b1f0-d51a-4ff0-85a8-31705a54e29a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:10.708305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:10.708962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:10.709246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:10.709512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:10.711196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:10.837404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:10.838872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fcc66-fa80-438e-9bd4-76c615f56b6b service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:10.858099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 669/1340] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:15.199630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:15.199630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:15.200311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:15.201547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 672/1341] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:15.207059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120a5a-c51e-428d-8455-45af0fdcf817 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:15.207494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120a5a-c51e-428d-8455-45af0fdcf817 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:15.207612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96120a5a-c51e-428d-8455-45af0fdcf817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:15.280398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-96120a5a-c51e-428d-8455-45af0fdcf817 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:15.281506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-96120a5a-c51e-428d-8455-45af0fdcf817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:15.386086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 670/1342] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:15.424640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:15.426949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:15.529787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2945-3b66-4b02-b4e8-9baeae43a8ea None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:15.533433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:15.534024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:15.534305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:15.534577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:15.544420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:15.545850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac7303-293e-47a2-ae71-28171c048a75 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:15.555890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 673/1343] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:56:18.429126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:18.429725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:18.429725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:18.431482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 671/1344] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:18.436898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdbd60-ea6a-43a8-a68e-15bfc1ada91a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:18.437325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdbd60-ea6a-43a8-a68e-15bfc1ada91a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:18.437435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdbd60-ea6a-43a8-a68e-15bfc1ada91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:18.465683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b3bdbd60-ea6a-43a8-a68e-15bfc1ada91a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:18.466927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b3bdbd60-ea6a-43a8-a68e-15bfc1ada91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:18.547398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 674/1345] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:18.584832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:18.586609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:18.600433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fd2b9-73f8-4910-898a-c6319c947fa0 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:18.604304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:18.604955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:18.605242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:18.605501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:18.615336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:18.616770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fbf2d-e5f8-42a2-80dd-f72d446020e1 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:18.626690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 672/1346] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:56:23.135639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668ade-70bd-4a09-bda6-79e783c0d1f7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:23.136226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668ade-70bd-4a09-bda6-79e783c0d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:23.136226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad668ade-70bd-4a09-bda6-79e783c0d1f7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:23.138022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 675/1347] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:23.143426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef030a-0df7-4494-983e-ff9b109469eb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:23.143849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef030a-0df7-4494-983e-ff9b109469eb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:23.143940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef030a-0df7-4494-983e-ff9b109469eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:23.163117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-afef030a-0df7-4494-983e-ff9b109469eb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:23.164297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-afef030a-0df7-4494-983e-ff9b109469eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:23.173992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 673/1348] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:23.211914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668ade-70bd-4a09-bda6-79e783c0d1f7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:23.223898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad668ade-70bd-4a09-bda6-79e783c0d1f7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:23.233165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:23.233987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:23.234302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:23.234576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:23.244371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:23.245809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce0371-3b67-4bf8-8d34-1fd01f4f3090 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:23.255328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 676/1349] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:28.486001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46902b-455b-4d02-86b4-79d1a62960fa None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:28.486869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46902b-455b-4d02-86b4-79d1a62960fa None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:28.487294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46902b-455b-4d02-86b4-79d1a62960fa None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:28.489521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 674/1350] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 09:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:28.494525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339049-460f-4cf2-aa3a-9f4bced2f785 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:28.495394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339049-460f-4cf2-aa3a-9f4bced2f785 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:28.495901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7339049-460f-4cf2-aa3a-9f4bced2f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:28.563581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c7339049-460f-4cf2-aa3a-9f4bced2f785 None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:28.565039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c7339049-460f-4cf2-aa3a-9f4bced2f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:28.645907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 677/1351] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 09:56:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:32.958728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261360-07de-4f80-a545-c4f01b4dd6c8 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:32.959286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261360-07de-4f80-a545-c4f01b4dd6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:32.959568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261360-07de-4f80-a545-c4f01b4dd6c8 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:32.961585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 675/1352] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 09:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:32.966638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb66a9-8450-4dc6-a4fb-f155c065fa34 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:32.967099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb66a9-8450-4dc6-a4fb-f155c065fa34 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:32.967220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb66a9-8450-4dc6-a4fb-f155c065fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:32.986804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fbbb66a9-8450-4dc6-a4fb-f155c065fa34 None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:32.988035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fbbb66a9-8450-4dc6-a4fb-f155c065fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:32.997801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 678/1353] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:34.463485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6804-0603-4166-940e-6c0bb115db69 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:34.464039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6804-0603-4166-940e-6c0bb115db69 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:34.464039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d6804-0603-4166-940e-6c0bb115db69 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:34.466060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 676/1354] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 09:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:34.471599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdda4d-e851-481e-8d54-ef37b1358c21 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:34.472186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdda4d-e851-481e-8d54-ef37b1358c21 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:34.472186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdda4d-e851-481e-8d54-ef37b1358c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:34.490593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-decdda4d-e851-481e-8d54-ef37b1358c21 None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:34.491854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-decdda4d-e851-481e-8d54-ef37b1358c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:34.501865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 679/1355] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 09:56:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:38.277234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fb4c-3937-4005-b3d2-b431c61dbe9b None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:38.277766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fb4c-3937-4005-b3d2-b431c61dbe9b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:38.277766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646fb4c-3937-4005-b3d2-b431c61dbe9b None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:38.279774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 677/1356] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:38.285250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5d2e-15f9-456c-b56e-30bf13c62ac2 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:38.285667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5d2e-15f9-456c-b56e-30bf13c62ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:38.285805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5d2e-15f9-456c-b56e-30bf13c62ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:38.304494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-332a5d2e-15f9-456c-b56e-30bf13c62ac2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:38.305686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-332a5d2e-15f9-456c-b56e-30bf13c62ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:38.313803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 680/1357] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:38.362511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f2f-307f-4fe5-8171-01b00ec2d17e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:38.362839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f2f-307f-4fe5-8171-01b00ec2d17e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:38.363118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f2f-307f-4fe5-8171-01b00ec2d17e None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:38.365040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 678/1358] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 09:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:38.370327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f10d-a7dd-4fc5-99dd-8bb0dde9428b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:38.370620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f10d-a7dd-4fc5-99dd-8bb0dde9428b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:38.370928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6f10d-a7dd-4fc5-99dd-8bb0dde9428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:38.417744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e1b6f10d-a7dd-4fc5-99dd-8bb0dde9428b None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:38.418970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e1b6f10d-a7dd-4fc5-99dd-8bb0dde9428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:38.520370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 681/1359] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:38.529324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a78f2f-307f-4fe5-8171-01b00ec2d17e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:38.550510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a78f2f-307f-4fe5-8171-01b00ec2d17e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:38.557616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:38.558574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:38.559069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:38.559490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:38.569353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:38.571129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8454865-2454-43a4-9a3c-5e33eb40c280 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:38.581228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 679/1360] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:56:41.086318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda9de-161d-4771-88c6-97d99f47c234 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:41.086995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda9de-161d-4771-88c6-97d99f47c234 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:41.086995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeda9de-161d-4771-88c6-97d99f47c234 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:41.088608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 682/1361] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:41.094111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e575b-b4d2-4d92-894f-c96c52fd1eed None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:41.094564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e575b-b4d2-4d92-894f-c96c52fd1eed None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:41.094685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e575b-b4d2-4d92-894f-c96c52fd1eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:41.113332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-247e575b-b4d2-4d92-894f-c96c52fd1eed None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:41.114523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-247e575b-b4d2-4d92-894f-c96c52fd1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:41.122723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 680/1362] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 09:56:41.167624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda9de-161d-4771-88c6-97d99f47c234 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:41.186216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeda9de-161d-4771-88c6-97d99f47c234 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:41.193097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:41.193828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:41.194171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:41.194506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:41.204820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:41.206688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cab3a5-4265-4d97-b138-e4bcc9b89ec6 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:41.221332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 683/1363] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:43.829139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327bd3-a80d-41cd-b233-cca07e5f94eb None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:43.829742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327bd3-a80d-41cd-b233-cca07e5f94eb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:43.829742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59327bd3-a80d-41cd-b233-cca07e5f94eb None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:43.832112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 681/1364] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:43.837615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d04d-0ecb-496c-90bb-1acee494fddd None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:43.838076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d04d-0ecb-496c-90bb-1acee494fddd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:43.838167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743d04d-0ecb-496c-90bb-1acee494fddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:43.856948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8743d04d-0ecb-496c-90bb-1acee494fddd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:43.858139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8743d04d-0ecb-496c-90bb-1acee494fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:43.866072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 684/1365] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:43.911916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be84ff-6ca1-4928-bdf6-9d9d998f79dd None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:43.912222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be84ff-6ca1-4928-bdf6-9d9d998f79dd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:43.912498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be84ff-6ca1-4928-bdf6-9d9d998f79dd None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:43.914302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 682/1366] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 09:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:43.919598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10237b1-cc5e-49b9-afcf-1a655529b458 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:43.919886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10237b1-cc5e-49b9-afcf-1a655529b458 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:43.920129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10237b1-cc5e-49b9-afcf-1a655529b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:43.939368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b10237b1-cc5e-49b9-afcf-1a655529b458 None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:43.940585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b10237b1-cc5e-49b9-afcf-1a655529b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:43.950347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 685/1367] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 09:56:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:43.958152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be84ff-6ca1-4928-bdf6-9d9d998f79dd None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:43.972770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be84ff-6ca1-4928-bdf6-9d9d998f79dd None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:43.978543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:43.979219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:43.980377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:43.980377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:43.989758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:43.991489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c07cb2-9179-4dd3-80c4-27f53d83460c service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:44.001768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 683/1368] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:46.346343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3115-0fa6-464b-99ae-5977cadcf64a None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.346981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3115-0fa6-464b-99ae-5977cadcf64a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.347268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e3115-0fa6-464b-99ae-5977cadcf64a None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.349412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 686/1369] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:46.355689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c202f-7e30-4f12-bc20-2b86c4163be4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.356297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c202f-7e30-4f12-bc20-2b86c4163be4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.356297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c202f-7e30-4f12-bc20-2b86c4163be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.376400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-582c202f-7e30-4f12-bc20-2b86c4163be4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:46.377566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-582c202f-7e30-4f12-bc20-2b86c4163be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:46.386704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 684/1370] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:46.392532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0409ed-b1ea-44f2-a9f7-74b15d59d3bd None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.392827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0409ed-b1ea-44f2-a9f7-74b15d59d3bd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.393108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0409ed-b1ea-44f2-a9f7-74b15d59d3bd None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.395040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 687/1371] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:46.400709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92f63-1b6d-42fd-b8f1-da029be41501 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.401008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92f63-1b6d-42fd-b8f1-da029be41501 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.401260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf92f63-1b6d-42fd-b8f1-da029be41501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.422757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4cf92f63-1b6d-42fd-b8f1-da029be41501 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:46.422757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4cf92f63-1b6d-42fd-b8f1-da029be41501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:46.430535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 685/1372] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:46.431844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0409ed-b1ea-44f2-a9f7-74b15d59d3bd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:46.446611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0409ed-b1ea-44f2-a9f7-74b15d59d3bd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:46.452285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:46.453041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.453324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.453604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.462478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:46.464181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074509f-29f3-4c1e-914d-5fe71ef62fe7 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:46.478284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 688/1373] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:46.720260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5430c-34d4-4cbc-9843-42542c6f1392 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.720260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5430c-34d4-4cbc-9843-42542c6f1392 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.720260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5430c-34d4-4cbc-9843-42542c6f1392 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.722118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 686/1374] 10.222.0.46 () {54 vars in 962 bytes} [Fri Apr 1 09:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:46.727296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a14e8-5451-4fe0-ba50-3634dfb33d25 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.727555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a14e8-5451-4fe0-ba50-3634dfb33d25 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.727844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a14e8-5451-4fe0-ba50-3634dfb33d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.775350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e68a14e8-5451-4fe0-ba50-3634dfb33d25 None None] MFA Rules not processed for user `a1ac29fcbcdc4bcfacfa2695a3bba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:46.776542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e68a14e8-5451-4fe0-ba50-3634dfb33d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:46.838227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 689/1375] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Apr 1 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:46.846392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5430c-34d4-4cbc-9843-42542c6f1392 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:46.857585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5430c-34d4-4cbc-9843-42542c6f1392 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:46.861642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:46.862581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:46.863204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:46.863554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:46.873863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:46.875640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f09aea-35f8-49cf-a303-9f92efefab18 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:46.885905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 687/1376] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:48.798074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e99a4-5aff-4879-9172-4e102be524d5 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:48.798708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e99a4-5aff-4879-9172-4e102be524d5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:48.798708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e99a4-5aff-4879-9172-4e102be524d5 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:48.800608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 690/1377] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:48.805932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d0ff-6045-43af-8631-68d4181d6fc1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:48.806449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d0ff-6045-43af-8631-68d4181d6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:48.806449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97d0ff-6045-43af-8631-68d4181d6fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:48.826523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9b97d0ff-6045-43af-8631-68d4181d6fc1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:48.827738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9b97d0ff-6045-43af-8631-68d4181d6fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:48.836132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 688/1378] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:48.880849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e99a4-5aff-4879-9172-4e102be524d5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:48.895605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e99a4-5aff-4879-9172-4e102be524d5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:48.901443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:48.902078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:48.902362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:48.902636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:48.910871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:48.912522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00eb41-8019-46ed-9136-2d7a1f759bbc service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:48.922217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 691/1379] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:51.215086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922980-b53b-4f4f-8cd2-67b007f9975e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:51.215702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922980-b53b-4f4f-8cd2-67b007f9975e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:51.215702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922980-b53b-4f4f-8cd2-67b007f9975e None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:51.217414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 689/1380] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:51.222891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e888-d698-467c-9b9c-0421516c1f32 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:51.223337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e888-d698-467c-9b9c-0421516c1f32 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:51.223425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7e888-d698-467c-9b9c-0421516c1f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:51.241528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4ed7e888-d698-467c-9b9c-0421516c1f32 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:51.242766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4ed7e888-d698-467c-9b9c-0421516c1f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:51.254543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 692/1381] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:51.294979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922980-b53b-4f4f-8cd2-67b007f9975e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:51.310414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922980-b53b-4f4f-8cd2-67b007f9975e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:51.316053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:51.316692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:51.316977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:51.317256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:51.325217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:51.326827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d720c1-bdff-4f82-b2d8-d66f9df62ade service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:51.336207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 690/1382] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:53.617539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29ff4-5b41-492a-893b-cf2fccb33142 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:53.618311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29ff4-5b41-492a-893b-cf2fccb33142 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:53.618786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd29ff4-5b41-492a-893b-cf2fccb33142 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:53.623015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 693/1383] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:53.626641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe17f-b72f-4bb2-915d-0daecda2d19c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:53.627469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe17f-b72f-4bb2-915d-0daecda2d19c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:53.627730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbe17f-b72f-4bb2-915d-0daecda2d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:53.646159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-60dbe17f-b72f-4bb2-915d-0daecda2d19c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:53.647381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-60dbe17f-b72f-4bb2-915d-0daecda2d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:53.655626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 691/1384] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:53.696859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd29ff4-5b41-492a-893b-cf2fccb33142 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:53.711977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd29ff4-5b41-492a-893b-cf2fccb33142 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:53.717720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:53.718461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:53.718946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:53.719331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:53.727688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:53.729353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6857a-6251-4d5a-9004-326dc5f88e20 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:53.738924 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 694/1385] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:56.253925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057d47-7924-474b-844d-f2e7db7dbb50 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:56.254552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057d47-7924-474b-844d-f2e7db7dbb50 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:56.254631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057d47-7924-474b-844d-f2e7db7dbb50 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:56.256661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 692/1386] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:56.262337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5fec-f7c0-4646-9dcc-6428b558b901 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:56.262849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5fec-f7c0-4646-9dcc-6428b558b901 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:56.262953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc5fec-f7c0-4646-9dcc-6428b558b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:56.282683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-18fc5fec-f7c0-4646-9dcc-6428b558b901 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:56.283914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-18fc5fec-f7c0-4646-9dcc-6428b558b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:56.293164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 695/1387] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:56.337512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18057d47-7924-474b-844d-f2e7db7dbb50 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:56.353956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18057d47-7924-474b-844d-f2e7db7dbb50 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:56.361232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:56.361926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:56.362215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:56.362495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:56.371690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:56.373340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa33cc-4747-49cc-912b-a87150469a49 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:56.383050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 693/1388] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:56:58.759430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaef2-e4ad-42de-b784-ceccf4ffadeb None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:58.760116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaef2-e4ad-42de-b784-ceccf4ffadeb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:58.760116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaef2-e4ad-42de-b784-ceccf4ffadeb None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:58.761749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 696/1389] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:56:58.767584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5658d6-0e96-41b4-9a79-b99edee2831f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:58.768041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5658d6-0e96-41b4-9a79-b99edee2831f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:58.768289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5658d6-0e96-41b4-9a79-b99edee2831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:58.788960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8e5658d6-0e96-41b4-9a79-b99edee2831f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:56:58.790544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8e5658d6-0e96-41b4-9a79-b99edee2831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:56:58.801678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 694/1390] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:56:58.846703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaef2-e4ad-42de-b784-ceccf4ffadeb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:56:58.871203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaef2-e4ad-42de-b784-ceccf4ffadeb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:56:58.880675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:56:58.881771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:56:58.882335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:56:58.882803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:56:58.896813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:56:58.900382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d5070-9768-433e-9c83-71e0c8ff2bf7 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:56:58.917089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 697/1391] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:56:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:01.787286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000f0f-4409-40f2-8176-857e8b59beb3 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:01.787911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000f0f-4409-40f2-8176-857e8b59beb3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:01.787911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14000f0f-4409-40f2-8176-857e8b59beb3 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:01.789505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 695/1392] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:57:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:01.795175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2664c16-af6a-4aa8-baa2-2a00a745cb0e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:01.795609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2664c16-af6a-4aa8-baa2-2a00a745cb0e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:01.795851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2664c16-af6a-4aa8-baa2-2a00a745cb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:01.814756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a2664c16-af6a-4aa8-baa2-2a00a745cb0e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:01.815973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a2664c16-af6a-4aa8-baa2-2a00a745cb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:01.825104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 698/1393] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:01.868164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14000f0f-4409-40f2-8176-857e8b59beb3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:01.884074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14000f0f-4409-40f2-8176-857e8b59beb3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:01.890820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:01.891576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:01.891998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:01.892409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:01.901859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:01.903473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e70a79-5574-4d98-a796-6a0ab6554c7a service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:01.913052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 696/1394] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:02.657939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac6d8-19a6-4bd3-b23c-a3b652d5352b None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:02.658208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac6d8-19a6-4bd3-b23c-a3b652d5352b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:02.658544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bac6d8-19a6-4bd3-b23c-a3b652d5352b None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:02.660459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 699/1395] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:02.665836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404dde-b423-4921-858d-b5906136126d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:02.666131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404dde-b423-4921-858d-b5906136126d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:02.666414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404dde-b423-4921-858d-b5906136126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:02.684224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f6404dde-b423-4921-858d-b5906136126d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:02.685433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f6404dde-b423-4921-858d-b5906136126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:02.694021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 697/1396] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:02.751186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e1b3-9291-4e3e-928e-9d6fb9c0f883 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:02.751475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e1b3-9291-4e3e-928e-9d6fb9c0f883 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:02.751818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7e1b3-9291-4e3e-928e-9d6fb9c0f883 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:02.753702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 700/1397] 10.222.0.46 () {54 vars in 961 bytes} [Fri Apr 1 09:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:02.758986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867514f-7458-459e-b9fe-b62dc0c3eafe None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:02.759275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867514f-7458-459e-b9fe-b62dc0c3eafe None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:02.759550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867514f-7458-459e-b9fe-b62dc0c3eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:02.807985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b867514f-7458-459e-b9fe-b62dc0c3eafe None None] MFA Rules not processed for user `aba5e29ac89d4fd19a1c882830c2ef1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:02.809176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b867514f-7458-459e-b9fe-b62dc0c3eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:02.869099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 698/1398] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Apr 1 09:57:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:02.876869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7e1b3-9291-4e3e-928e-9d6fb9c0f883 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:02.888421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7e1b3-9291-4e3e-928e-9d6fb9c0f883 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:02.892221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:02.892860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:02.893140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:02.893411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:02.902695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:02.904130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b027b5-838a-4db5-afad-900660fc3e1f service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:02.915149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 701/1399] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:03.346623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df60396-dad3-437a-b607-795c08e86a07 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:03.346984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df60396-dad3-437a-b607-795c08e86a07 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:03.347265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df60396-dad3-437a-b607-795c08e86a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:03.394359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-7df60396-dad3-437a-b607-795c08e86a07 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:03.395605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7df60396-dad3-437a-b607-795c08e86a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:03.457053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 699/1400] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:03.502561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71990d-8542-4e8b-9cd9-85b9324efbf6 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:03.502905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71990d-8542-4e8b-9cd9-85b9324efbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:03.503136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71990d-8542-4e8b-9cd9-85b9324efbf6 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:03.504937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 702/1401] 10.222.0.46 () {54 vars in 942 bytes} [Fri Apr 1 09:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:03.511564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015dd7-15a9-4357-aecc-c16a3e74462d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:03.511839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015dd7-15a9-4357-aecc-c16a3e74462d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:03.512120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015dd7-15a9-4357-aecc-c16a3e74462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:03.577794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2d015dd7-15a9-4357-aecc-c16a3e74462d None None] MFA Rules not processed for user `a3b5af1ed1a34c219c29b23c6ee49ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:03.579997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2d015dd7-15a9-4357-aecc-c16a3e74462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:03.655792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 700/1402] 10.222.0.46 () {58 vars in 1039 bytes} [Fri Apr 1 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:03.665197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71990d-8542-4e8b-9cd9-85b9324efbf6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:03.678906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71990d-8542-4e8b-9cd9-85b9324efbf6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:03.684133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:03.684788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:03.685068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:03.685340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:03.693562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:03.695252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523925b-92f6-4206-9b2a-9677bc366e38 service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:03.703457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 703/1403] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 09:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 09:57:04.212595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf4c4-c333-4898-b789-3816d46426a5 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:04.213211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf4c4-c333-4898-b789-3816d46426a5 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:04.213211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf4c4-c333-4898-b789-3816d46426a5 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:04.215244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 701/1404] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:04.220857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116d52-c116-4644-9640-9329b64f09b5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:04.221265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116d52-c116-4644-9640-9329b64f09b5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:04.221417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116d52-c116-4644-9640-9329b64f09b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:04.239743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e7116d52-c116-4644-9640-9329b64f09b5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:04.240966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e7116d52-c116-4644-9640-9329b64f09b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:04.249032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 704/1405] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:04.293638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf4c4-c333-4898-b789-3816d46426a5 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:04.311603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf4c4-c333-4898-b789-3816d46426a5 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:04.317227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:04.318027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:04.318311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:04.318584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:04.327921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:04.329569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dee96-4139-4df6-a3ab-0614b77a4326 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:04.338956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 702/1406] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:06.659583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f23-d790-4e52-a1a6-4c0caa4004b6 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:06.660520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f23-d790-4e52-a1a6-4c0caa4004b6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:06.660806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7240f23-d790-4e52-a1a6-4c0caa4004b6 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:06.662640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 705/1407] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:06.667970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27149-0108-4856-8801-aed4000d1bd6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:06.668390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27149-0108-4856-8801-aed4000d1bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:06.668577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e27149-0108-4856-8801-aed4000d1bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:06.688232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-07e27149-0108-4856-8801-aed4000d1bd6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:06.689470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-07e27149-0108-4856-8801-aed4000d1bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:06.697661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 703/1408] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:06.742413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f23-d790-4e52-a1a6-4c0caa4004b6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:06.757746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7240f23-d790-4e52-a1a6-4c0caa4004b6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:06.766630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:06.767435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:06.767726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:06.768010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:06.777548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:06.779212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4586b9-b461-4696-9eab-9c34f645d20a service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:06.788983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 706/1409] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:26.587060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b10ef8-bbaa-48ae-a07a-74754cdf037c None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:26.588587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b10ef8-bbaa-48ae-a07a-74754cdf037c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:26.588587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b10ef8-bbaa-48ae-a07a-74754cdf037c None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:26.590599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 704/1410] 10.222.0.46 () {54 vars in 918 bytes} [Fri Apr 1 09:57:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:26.596311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ff64-c469-44cf-8e3e-37a44d9b187d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:26.596837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ff64-c469-44cf-8e3e-37a44d9b187d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:26.596837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4ff64-c469-44cf-8e3e-37a44d9b187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:26.616485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-16b4ff64-c469-44cf-8e3e-37a44d9b187d None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:26.617681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-16b4ff64-c469-44cf-8e3e-37a44d9b187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:26.627157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 707/1411] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Apr 1 09:57:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:26.646794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7d830-f997-4780-ae18-4372acbd28ac None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:26.647105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7d830-f997-4780-ae18-4372acbd28ac None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:26.647447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7d830-f997-4780-ae18-4372acbd28ac None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:26.650489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 705/1412] 10.222.0.46 () {54 vars in 918 bytes} [Fri Apr 1 09:57:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:26.656835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ac67-f106-40ea-9bce-7b5390c60085 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:26.657124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ac67-f106-40ea-9bce-7b5390c60085 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:26.657414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42ac67-f106-40ea-9bce-7b5390c60085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:26.675709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6b42ac67-f106-40ea-9bce-7b5390c60085 None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:26.677221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6b42ac67-f106-40ea-9bce-7b5390c60085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:26.686905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 708/1413] 10.222.0.46 () {58 vars in 1015 bytes} [Fri Apr 1 09:57:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:29.446796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620382-91ab-4c45-91e2-e41019de9adc None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:29.447674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620382-91ab-4c45-91e2-e41019de9adc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:29.447674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80620382-91ab-4c45-91e2-e41019de9adc None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:29.450550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:29.456071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb098d-841e-4630-9489-7b195fb1d430 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:29.456522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb098d-841e-4630-9489-7b195fb1d430 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:29.456641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb098d-841e-4630-9489-7b195fb1d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:29.476157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d0bb098d-841e-4630-9489-7b195fb1d430 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:29.477412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d0bb098d-841e-4630-9489-7b195fb1d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:29.486577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:29.527808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80620382-91ab-4c45-91e2-e41019de9adc None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:29.543641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80620382-91ab-4c45-91e2-e41019de9adc None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:29.549753 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:29.550386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:29.550691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:29.550969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:29.558847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:29.560415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42bf80-1b3f-4302-afa0-d308a5d042cf service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:29.570141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 707/1416] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:30.896782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551763ac-0cf8-40e5-8f4b-f9113a51615e None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:30.897357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551763ac-0cf8-40e5-8f4b-f9113a51615e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:30.897357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551763ac-0cf8-40e5-8f4b-f9113a51615e None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:30.899531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:30.904586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca012-af4b-4da9-ae3b-a02a7f8a5ae0 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:30.905062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca012-af4b-4da9-ae3b-a02a7f8a5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:30.905175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ca012-af4b-4da9-ae3b-a02a7f8a5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:30.924750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-749ca012-af4b-4da9-ae3b-a02a7f8a5ae0 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:30.925923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-749ca012-af4b-4da9-ae3b-a02a7f8a5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:30.934080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:31.098677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551763ac-0cf8-40e5-8f4b-f9113a51615e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:31.114546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551763ac-0cf8-40e5-8f4b-f9113a51615e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:31.120864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:31.121489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:31.121769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:31.122041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:31.134212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:31.135809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f606037-a2d6-4f1d-9366-c970e124c042 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:31.147101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 711/1419] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:32.452510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248631f-92d0-440c-8861-63d049ad4636 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:32.453501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248631f-92d0-440c-8861-63d049ad4636 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:32.453501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248631f-92d0-440c-8861-63d049ad4636 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:32.455445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:32.460449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c16c0-5da1-491e-aacf-8434a9ecd7c8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:32.460894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c16c0-5da1-491e-aacf-8434a9ecd7c8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:32.460998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c16c0-5da1-491e-aacf-8434a9ecd7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:32.480052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-dc3c16c0-5da1-491e-aacf-8434a9ecd7c8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:32.481231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-dc3c16c0-5da1-491e-aacf-8434a9ecd7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:32.489484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:32.640283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248631f-92d0-440c-8861-63d049ad4636 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:32.658592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248631f-92d0-440c-8861-63d049ad4636 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:32.664664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:32.665291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:32.665570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:32.665845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:32.674036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:32.675637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b395f-f9d6-44bd-8f40-3aab87e6534e service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:32.684825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 710/1422] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:33.990809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344af8-e779-47ef-9757-4f1260a65ac6 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:33.991731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344af8-e779-47ef-9757-4f1260a65ac6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:33.991731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb344af8-e779-47ef-9757-4f1260a65ac6 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:33.994434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:34.002130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7974b-aed8-43b0-b350-a3dc5709aaf2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:34.002561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7974b-aed8-43b0-b350-a3dc5709aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:34.002722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7974b-aed8-43b0-b350-a3dc5709aaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:34.021563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d2e7974b-aed8-43b0-b350-a3dc5709aaf2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:34.022833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d2e7974b-aed8-43b0-b350-a3dc5709aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:34.031841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:34.192654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344af8-e779-47ef-9757-4f1260a65ac6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:34.218334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb344af8-e779-47ef-9757-4f1260a65ac6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:34.225785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:34.226429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:34.226738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:34.227017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:34.235645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:34.237238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e7aa-7a5b-455b-ba35-cdbca08e2bde service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:34.246938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 714/1425] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:35.528587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60a1b-b623-4a54-af2b-4ff321896a84 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:35.529390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60a1b-b623-4a54-af2b-4ff321896a84 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:35.529491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b60a1b-b623-4a54-af2b-4ff321896a84 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:35.532378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:35.540633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbac4f-8450-414d-9aca-055808e2760a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:35.541358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbac4f-8450-414d-9aca-055808e2760a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:35.541525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbac4f-8450-414d-9aca-055808e2760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:35.568314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d2cbac4f-8450-414d-9aca-055808e2760a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:35.569526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d2cbac4f-8450-414d-9aca-055808e2760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:35.578517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:35.728837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60a1b-b623-4a54-af2b-4ff321896a84 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:35.751706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b60a1b-b623-4a54-af2b-4ff321896a84 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:35.758898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:35.759544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:35.759822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:35.760091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:35.768679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:35.770270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bab36-a47a-4443-a734-8fce9ef15adc service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:35.780370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 713/1428] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:37.001354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6dfca-7ec8-4d1b-8639-6052234d40e0 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:37.001949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6dfca-7ec8-4d1b-8639-6052234d40e0 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:37.001949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6dfca-7ec8-4d1b-8639-6052234d40e0 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:37.003763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:37.010194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996166-3426-4a30-9cb8-fc9cbab7b8a9 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:37.010661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996166-3426-4a30-9cb8-fc9cbab7b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:37.010810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996166-3426-4a30-9cb8-fc9cbab7b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:37.030583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-36996166-3426-4a30-9cb8-fc9cbab7b8a9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:37.031835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-36996166-3426-4a30-9cb8-fc9cbab7b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:37.040024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:37.190485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6dfca-7ec8-4d1b-8639-6052234d40e0 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:37.215422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6dfca-7ec8-4d1b-8639-6052234d40e0 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:37.223780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:37.224425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:37.224707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:37.224979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:37.233758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:37.235414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd42ab-62ed-4f07-bacf-3b3ef51d68a7 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:37.245165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 717/1431] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:38.484879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9be4-d27e-4b08-aeee-bc346ec72219 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:38.485448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9be4-d27e-4b08-aeee-bc346ec72219 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:38.485448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb9be4-d27e-4b08-aeee-bc346ec72219 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:38.487283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:38.493121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae50f-b9a9-4080-8321-c9b29291fa68 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:38.493585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae50f-b9a9-4080-8321-c9b29291fa68 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:38.493772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ae50f-b9a9-4080-8321-c9b29291fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:38.513067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a96ae50f-b9a9-4080-8321-c9b29291fa68 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:38.514271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a96ae50f-b9a9-4080-8321-c9b29291fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:38.522249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:38.676396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb9be4-d27e-4b08-aeee-bc346ec72219 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:38.697311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb9be4-d27e-4b08-aeee-bc346ec72219 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:38.703238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:38.703885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:38.704167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:38.704445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:38.712494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:38.714074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15389ff0-d5f4-402e-afde-006fedd8cae2 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:38.726710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 716/1434] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:39.951464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa284e-5936-46b7-8b8f-fee2fcbbb5d2 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:39.952423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa284e-5936-46b7-8b8f-fee2fcbbb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:39.952423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa284e-5936-46b7-8b8f-fee2fcbbb5d2 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:39.954739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:39.960235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a04b-ba02-400a-afa9-c1cb5648b99e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:39.960667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a04b-ba02-400a-afa9-c1cb5648b99e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:39.960789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a04b-ba02-400a-afa9-c1cb5648b99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:39.980903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4792a04b-ba02-400a-afa9-c1cb5648b99e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:39.982136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4792a04b-ba02-400a-afa9-c1cb5648b99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:39.992361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:40.144902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa284e-5936-46b7-8b8f-fee2fcbbb5d2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:40.161301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa284e-5936-46b7-8b8f-fee2fcbbb5d2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:40.167271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:40.167903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:40.168181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:40.168455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:40.176641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:40.178217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f601aa-1a55-4842-b7a6-160a6a63f534 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:40.188050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 720/1437] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:41.471839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e03c67-4f12-403b-9c40-1600dc7ce32b None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:41.472398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e03c67-4f12-403b-9c40-1600dc7ce32b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:41.472398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e03c67-4f12-403b-9c40-1600dc7ce32b None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:41.474190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 09:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:41.480516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe180-9622-4f6d-8149-e6eea74e6ab9 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:41.481034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe180-9622-4f6d-8149-e6eea74e6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:41.481243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbe180-9622-4f6d-8149-e6eea74e6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:41.510522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-16fbe180-9622-4f6d-8149-e6eea74e6ab9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:41.512349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-16fbe180-9622-4f6d-8149-e6eea74e6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:41.526680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 09:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:41.675063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e03c67-4f12-403b-9c40-1600dc7ce32b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:41.694608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e03c67-4f12-403b-9c40-1600dc7ce32b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:41.701664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:41.702318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:41.702597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:41.703035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:41.712132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:41.713741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5762638-0954-4d21-b908-d5723b460a5d service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:41.724106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 719/1440] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:43.876852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6cce-b13e-40fe-b077-48a370ab46da None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:43.877388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6cce-b13e-40fe-b077-48a370ab46da None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:43.877388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e6cce-b13e-40fe-b077-48a370ab46da None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:43.879166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:43.885770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1384af-c9e6-401e-8889-0da0e66f300e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:43.886479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1384af-c9e6-401e-8889-0da0e66f300e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:43.886695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1384af-c9e6-401e-8889-0da0e66f300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:43.913926 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-db1384af-c9e6-401e-8889-0da0e66f300e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:43.915173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-db1384af-c9e6-401e-8889-0da0e66f300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:43.924128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:43.963486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6cce-b13e-40fe-b077-48a370ab46da None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:43.974967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e6cce-b13e-40fe-b077-48a370ab46da None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:43.978896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:43.979534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:43.979817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:43.980093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:43.989332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:43.990815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14299efc-a326-45f8-ae35-e232f75cf068 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:44.000627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 723/1443] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:46.404793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2205fd-fd38-43a8-879b-c91e0757ee8a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:46.405361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2205fd-fd38-43a8-879b-c91e0757ee8a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:46.405361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2205fd-fd38-43a8-879b-c91e0757ee8a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:46.407207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:46.413791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41672ac6-df88-4436-bd88-3e020cdff428 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:46.414556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41672ac6-df88-4436-bd88-3e020cdff428 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:46.414777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41672ac6-df88-4436-bd88-3e020cdff428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:46.437125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-41672ac6-df88-4436-bd88-3e020cdff428 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:46.438374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-41672ac6-df88-4436-bd88-3e020cdff428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:46.447144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:46.487170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2205fd-fd38-43a8-879b-c91e0757ee8a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:46.499680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2205fd-fd38-43a8-879b-c91e0757ee8a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:46.504568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:46.505213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:46.505494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:46.505802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:46.515856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:46.517329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7926e2c-73d6-4639-9a41-c6e986f3ff09 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:46.527241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 722/1446] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:49.055747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b2ad-14ad-4fc8-8e9a-2c853e29a7dc None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:49.056376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b2ad-14ad-4fc8-8e9a-2c853e29a7dc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:49.056376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6b2ad-14ad-4fc8-8e9a-2c853e29a7dc None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:49.059026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:49.066147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f161cf-244e-4c64-9650-d931ccdec555 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:49.066632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f161cf-244e-4c64-9650-d931ccdec555 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:49.066767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f161cf-244e-4c64-9650-d931ccdec555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:49.084678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-34f161cf-244e-4c64-9650-d931ccdec555 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:49.085848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-34f161cf-244e-4c64-9650-d931ccdec555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:49.094182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 09:57:49.134954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b2ad-14ad-4fc8-8e9a-2c853e29a7dc None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:49.153415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6b2ad-14ad-4fc8-8e9a-2c853e29a7dc None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:49.159243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:49.159884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:49.160166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:49.160436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:49.169231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:49.170686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda5bff-ca4b-4fc1-a529-e26f969dd979 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:49.180146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 726/1449] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:51.535099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137471ea-571c-4ea4-9e32-227cd03c5fa2 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:51.535923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137471ea-571c-4ea4-9e32-227cd03c5fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:51.536062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137471ea-571c-4ea4-9e32-227cd03c5fa2 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:51.539022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:51.544402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca704d-6851-4453-9e2e-b0b283c70c0d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:51.544874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca704d-6851-4453-9e2e-b0b283c70c0d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:51.544977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca704d-6851-4453-9e2e-b0b283c70c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:51.564444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-29ca704d-6851-4453-9e2e-b0b283c70c0d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:51.565626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-29ca704d-6851-4453-9e2e-b0b283c70c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:51.573881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:51.614368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137471ea-571c-4ea4-9e32-227cd03c5fa2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:51.627057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137471ea-571c-4ea4-9e32-227cd03c5fa2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:51.631705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:51.632351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:51.632635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:51.632919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:51.642525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:51.643995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929663c9-d7c5-4fb8-a179-ed90b2c3ee63 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:51.653733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 725/1452] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:54.113941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b9ac-8ffc-4e07-a46f-4c9d4249a66d None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:54.114526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b9ac-8ffc-4e07-a46f-4c9d4249a66d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:54.114526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59b9ac-8ffc-4e07-a46f-4c9d4249a66d None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:54.116317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:54.122674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15613f9-c780-4f69-a936-a64c7e9b9cdc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:54.123406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15613f9-c780-4f69-a936-a64c7e9b9cdc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:54.123573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15613f9-c780-4f69-a936-a64c7e9b9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:54.149418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a15613f9-c780-4f69-a936-a64c7e9b9cdc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:54.151025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a15613f9-c780-4f69-a936-a64c7e9b9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:54.160865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:54.198672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b9ac-8ffc-4e07-a46f-4c9d4249a66d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:54.211836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59b9ac-8ffc-4e07-a46f-4c9d4249a66d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:54.215731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:54.216369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:54.216645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:54.216920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:54.226210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:54.227679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33690af0-5e3f-45bb-b600-e6c66f394756 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:54.236973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 729/1455] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 09:57:56.532089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53dfd-cd95-4330-b0bd-ff9fc29f2532 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:56.532904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53dfd-cd95-4330-b0bd-ff9fc29f2532 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:56.533065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e53dfd-cd95-4330-b0bd-ff9fc29f2532 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:56.535892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:56.544499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc116c-defb-4633-a89c-00d1125fff84 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:56.544936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc116c-defb-4633-a89c-00d1125fff84 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:56.545068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc116c-defb-4633-a89c-00d1125fff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:56.570550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9cfc116c-defb-4633-a89c-00d1125fff84 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:56.571790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9cfc116c-defb-4633-a89c-00d1125fff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:56.581226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:56.622000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e53dfd-cd95-4330-b0bd-ff9fc29f2532 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:56.635659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e53dfd-cd95-4330-b0bd-ff9fc29f2532 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:56.640597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:56.641263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:56.641545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:56.641822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:56.651657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:56.653077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce91d5a-0af7-4930-ab35-ecb4445b2eb1 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:56.662592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 728/1458] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:58.999936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342b03-1c58-4cce-b5c7-2c3100b65be4 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:59.000605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342b03-1c58-4cce-b5c7-2c3100b65be4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:59.000605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3342b03-1c58-4cce-b5c7-2c3100b65be4 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:59.002408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:57:59.008870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f259f-c9a2-4060-a1e0-1d8e883d9420 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:59.009307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f259f-c9a2-4060-a1e0-1d8e883d9420 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:59.009420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f259f-c9a2-4060-a1e0-1d8e883d9420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:59.035325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f49f259f-c9a2-4060-a1e0-1d8e883d9420 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:57:59.036541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f49f259f-c9a2-4060-a1e0-1d8e883d9420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:57:59.046036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:57:59.086830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342b03-1c58-4cce-b5c7-2c3100b65be4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:57:59.099347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3342b03-1c58-4cce-b5c7-2c3100b65be4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:57:59.103476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:57:59.104117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:57:59.104398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:57:59.104671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:57:59.114597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:57:59.116054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4824-4174-41f3-8e59-fc59beb6ffa7 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:57:59.125773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 732/1461] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:01.408542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acad52-f500-4ac2-aaed-9a409179d518 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:01.409133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acad52-f500-4ac2-aaed-9a409179d518 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:01.409133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acad52-f500-4ac2-aaed-9a409179d518 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:01.410913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:01.417375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4588d00-8262-4601-a43e-d587ce0f7864 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:01.418162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4588d00-8262-4601-a43e-d587ce0f7864 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:01.418305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4588d00-8262-4601-a43e-d587ce0f7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:01.438588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b4588d00-8262-4601-a43e-d587ce0f7864 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:01.439871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b4588d00-8262-4601-a43e-d587ce0f7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:01.448892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:01.485488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acad52-f500-4ac2-aaed-9a409179d518 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:01.497127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acad52-f500-4ac2-aaed-9a409179d518 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:01.501346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:01.501980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:01.502258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:01.502528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:01.512720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:01.514156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31589e1c-1702-42b5-b5e1-980b4a3decab service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:01.523988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 731/1464] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:03.776376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec5fa-8360-4b2b-ba55-41a0e88ffb20 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:03.777162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec5fa-8360-4b2b-ba55-41a0e88ffb20 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:03.777162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fec5fa-8360-4b2b-ba55-41a0e88ffb20 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:03.779996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:58:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:03.788729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e68c-9337-4490-94bb-0fb6085e4b2d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:03.789151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e68c-9337-4490-94bb-0fb6085e4b2d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:03.789330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e68c-9337-4490-94bb-0fb6085e4b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:03.811331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4344e68c-9337-4490-94bb-0fb6085e4b2d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:03.812541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4344e68c-9337-4490-94bb-0fb6085e4b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:03.821667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:03.860734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fec5fa-8360-4b2b-ba55-41a0e88ffb20 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:03.873564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fec5fa-8360-4b2b-ba55-41a0e88ffb20 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:03.878100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:03.878775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:03.879083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:03.879363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:03.889251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:03.890678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14e81-9714-4bb5-a114-ad3c57f7327c service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:03.900706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 735/1467] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:06.238950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba20f5-9168-4a52-b284-b8cbdd6ffb6a None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:06.239569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba20f5-9168-4a52-b284-b8cbdd6ffb6a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:06.239569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba20f5-9168-4a52-b284-b8cbdd6ffb6a None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:06.241373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 09:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:58:06.247546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123e16-ac9b-406c-8897-830ef6604170 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:06.248118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123e16-ac9b-406c-8897-830ef6604170 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:06.248118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123e16-ac9b-406c-8897-830ef6604170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:06.267541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-93123e16-ac9b-406c-8897-830ef6604170 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:06.268778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-93123e16-ac9b-406c-8897-830ef6604170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:06.279123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:06.315272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba20f5-9168-4a52-b284-b8cbdd6ffb6a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:06.332786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba20f5-9168-4a52-b284-b8cbdd6ffb6a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:06.339596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:06.340574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:06.340938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:06.341373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:06.352638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:06.354062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2734e3-b0c4-439d-95e3-f68e6d342de7 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:06.363387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 734/1470] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:26.742265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e7442-b151-4b35-af60-86389a3411d4 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:26.743147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e7442-b151-4b35-af60-86389a3411d4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:26.743147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e7442-b151-4b35-af60-86389a3411d4 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:26.745637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 737/1471] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:26.752894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e2b2-f435-49de-9410-897d08693250 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:26.753330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e2b2-f435-49de-9410-897d08693250 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:26.753436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165e2b2-f435-49de-9410-897d08693250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:26.772552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9165e2b2-f435-49de-9410-897d08693250 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:26.773748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9165e2b2-f435-49de-9410-897d08693250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:26.782444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 735/1472] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:26.839347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2af81-c87b-4cf1-99f4-71bc6e14db2e None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:26.839657 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2af81-c87b-4cf1-99f4-71bc6e14db2e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:26.839937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2af81-c87b-4cf1-99f4-71bc6e14db2e None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:26.841687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 738/1473] 10.222.0.46 () {54 vars in 961 bytes} [Fri Apr 1 09:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 09:58:26.846779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661466-5426-44d4-a5e8-89d79c69b108 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:26.847101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661466-5426-44d4-a5e8-89d79c69b108 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:26.847382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc661466-5426-44d4-a5e8-89d79c69b108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:26.865638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fc661466-5426-44d4-a5e8-89d79c69b108 None None] MFA Rules not processed for user `aba5e29ac89d4fd19a1c882830c2ef1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:26.866848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fc661466-5426-44d4-a5e8-89d79c69b108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:26.873658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 736/1474] 10.222.0.46 () {58 vars in 1058 bytes} [Fri Apr 1 09:58:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:26.880775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2af81-c87b-4cf1-99f4-71bc6e14db2e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:26.891963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2af81-c87b-4cf1-99f4-71bc6e14db2e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:26.896153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:26.896782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:26.897056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:26.897328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:26.906865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:26.908278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b0cec-e198-4cf6-812d-8192d01f27e0 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:26.917595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 739/1475] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:29.251992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ad43-e09f-4778-ba74-2adf071a20bc None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:29.252603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ad43-e09f-4778-ba74-2adf071a20bc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:29.252603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6ad43-e09f-4778-ba74-2adf071a20bc None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:29.254339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 737/1476] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:29.260674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436121e-0cc6-4331-804e-4ae7f54ee0f5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:29.261444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436121e-0cc6-4331-804e-4ae7f54ee0f5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:29.261625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436121e-0cc6-4331-804e-4ae7f54ee0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:29.283195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8436121e-0cc6-4331-804e-4ae7f54ee0f5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:29.284386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8436121e-0cc6-4331-804e-4ae7f54ee0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:29.292801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 740/1477] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:29.315592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6ad43-e09f-4778-ba74-2adf071a20bc None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:29.328603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6ad43-e09f-4778-ba74-2adf071a20bc None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:29.333930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:29.334570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:29.334876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:29.335152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:29.335882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:29.337630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 09:58:29.337630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 09:58:29.337630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 09:58:29.338794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9af0a-2202-4074-b442-2f3c232bc8d1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:29.357531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 738/1478] 10.222.0.46 () {56 vars in 1108 bytes} [Fri Apr 1 09:58:29 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 09:58:31.642131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8238-0e29-4029-9e92-5839fd82eb08 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:31.643072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8238-0e29-4029-9e92-5839fd82eb08 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:31.643072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8238-0e29-4029-9e92-5839fd82eb08 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:31.645985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 741/1479] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:31.651880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d9d9-5a2d-4b81-ae51-bdc1b30e62a4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:31.652305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d9d9-5a2d-4b81-ae51-bdc1b30e62a4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:31.652416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d9d9-5a2d-4b81-ae51-bdc1b30e62a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:31.676449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1da0d9d9-5a2d-4b81-ae51-bdc1b30e62a4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:31.677634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1da0d9d9-5a2d-4b81-ae51-bdc1b30e62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:31.686463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 739/1480] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:31.730584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8238-0e29-4029-9e92-5839fd82eb08 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:31.753650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8238-0e29-4029-9e92-5839fd82eb08 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:31.760240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:31.760874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:31.761156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:31.761429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:31.769710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:31.771324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76efeb8-865c-4d70-87e0-0cdbbf1f3e0d service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:31.780858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 742/1481] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:34.203764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6ac-f255-420b-a85f-28ccaa5f2ccf None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:34.204389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6ac-f255-420b-a85f-28ccaa5f2ccf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:34.204389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35d6ac-f255-420b-a85f-28ccaa5f2ccf None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:34.206994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 740/1482] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:34.215139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27c8c-ccc7-4068-8c4f-d2fed13301f7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:34.215630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27c8c-ccc7-4068-8c4f-d2fed13301f7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:34.215736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27c8c-ccc7-4068-8c4f-d2fed13301f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:34.234492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-76a27c8c-ccc7-4068-8c4f-d2fed13301f7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:34.235790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-76a27c8c-ccc7-4068-8c4f-d2fed13301f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:34.244952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 743/1483] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:34.280340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35d6ac-f255-420b-a85f-28ccaa5f2ccf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:34.292262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35d6ac-f255-420b-a85f-28ccaa5f2ccf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:34.295979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:34.296625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:34.296914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:34.297193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:34.306367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:34.307847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37ab1f-1ac6-4642-8bd8-c9b61ce1c959 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:34.317387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 741/1484] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:36.608740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4479-0e1e-44b6-a1d9-fdd67b294977 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:36.609326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4479-0e1e-44b6-a1d9-fdd67b294977 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:36.609326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4479-0e1e-44b6-a1d9-fdd67b294977 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:36.611309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 744/1485] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:36.616945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353591-0dc3-4729-96b9-acb7a2d3c69b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:36.617419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353591-0dc3-4729-96b9-acb7a2d3c69b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:36.617513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6353591-0dc3-4729-96b9-acb7a2d3c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:36.637135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e6353591-0dc3-4729-96b9-acb7a2d3c69b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:36.638319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e6353591-0dc3-4729-96b9-acb7a2d3c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:36.646940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 742/1486] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 09:58:36.684239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4479-0e1e-44b6-a1d9-fdd67b294977 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:36.696811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4479-0e1e-44b6-a1d9-fdd67b294977 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:36.701079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:36.701710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:36.701987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:36.702258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:36.711621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:36.713057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb13a5-506e-4164-9b21-008bf9e0d686 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:36.722877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 745/1487] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:39.044551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200233-a5db-46fb-84c6-3b828584d340 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:39.045465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200233-a5db-46fb-84c6-3b828584d340 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:39.045465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200233-a5db-46fb-84c6-3b828584d340 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:39.048062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 743/1488] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:39.053337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877420-73d3-4b43-a1c5-2da81a3de4a4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:39.053788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877420-73d3-4b43-a1c5-2da81a3de4a4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:39.053899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba877420-73d3-4b43-a1c5-2da81a3de4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:39.073004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ba877420-73d3-4b43-a1c5-2da81a3de4a4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:39.074185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ba877420-73d3-4b43-a1c5-2da81a3de4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:39.082410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 746/1489] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:39.125063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200233-a5db-46fb-84c6-3b828584d340 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:39.142314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200233-a5db-46fb-84c6-3b828584d340 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:39.146424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:39.147098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:39.147380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:39.147653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:39.157647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:39.159164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc363a-daf0-4fec-8104-a9e3a67e9b51 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:39.168680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 744/1490] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 09:58:41.645564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ebce-c973-4169-89f0-b08a6b2af9d9 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:41.646144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ebce-c973-4169-89f0-b08a6b2af9d9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:41.646144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387ebce-c973-4169-89f0-b08a6b2af9d9 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:41.647910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 747/1491] 10.222.0.46 () {54 vars in 926 bytes} [Fri Apr 1 09:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 09:58:41.654474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690072-6c92-4c80-ac03-2c57fb6c4b18 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:41.654965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690072-6c92-4c80-ac03-2c57fb6c4b18 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:41.655162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690072-6c92-4c80-ac03-2c57fb6c4b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:41.675760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1e690072-6c92-4c80-ac03-2c57fb6c4b18 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 09:58:41.676960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1e690072-6c92-4c80-ac03-2c57fb6c4b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 09:58:41.686067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 745/1492] 10.222.0.46 () {58 vars in 1023 bytes} [Fri Apr 1 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 09:58:41.724726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ebce-c973-4169-89f0-b08a6b2af9d9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 09:58:41.743188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387ebce-c973-4169-89f0-b08a6b2af9d9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 09:58:41.749587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 09:58:41.750563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 09:58:41.750871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 09:58:41.751140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 09:58:41.761128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 09:58:41.762550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bad27a-dfc0-4391-8566-eca90e47a8e9 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 09:58:41.772278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 748/1493] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 09:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:00:27.707399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:27.708008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:27.708008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:27.726797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:00:27.727976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:27.737229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 746/1494] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:00:27.746503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:27.747056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:27.747056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:27.767064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:00:27.768261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:27.778695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 749/1495] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:00:27.783853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:27.797848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286ef8-10b9-45ed-bb20-2d0549c80933 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:27.803779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:27.804439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:27.804718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:27.804989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:27.805743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:00:27.806049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:27.807139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:27.807139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:00:27.807139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:00:27.808017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:27.819612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 747/1496] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:00:27.827569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:27.836673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32921dba-ca7d-4ca1-9703-1900a074001b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:27.842228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:27.842917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:27.843215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:27.843482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:27.844178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:27.845931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:27.845931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:00:27.845931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:00:27.847163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:27.888663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 750/1497] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:00:27 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:00:27.892999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:27.903642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d432-2ea2-46ea-976e-98b6e34586c7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:27.963302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:27.963898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:27.964177 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:27.964422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:27.965219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:27.966230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:27.966230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:00:27.966230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:00:27.967449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:27.989907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 748/1498] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:00:27 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:00:27.994084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.004082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a3ab3-57ed-4f62-a1bf-5de98d76daac admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.008927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.009582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.009858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.010152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.010896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.011960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:28.011960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:00:28.011960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:00:28.012830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.025727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 751/1499] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:00:28.030180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.040411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f28bc3-babb-4a31-ad93-0d9e3cef0c83 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.045895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.046552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.046860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.047136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.047859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.048869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:28.048869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:00:28.048869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:00:28.049749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eeec3-ced2-424b-854a-ce28ba6d3a12 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.063145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 749/1500] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:00:28.067306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.077031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554587-5893-4865-bc65-ae4781aa5749 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.081609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.082488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.082801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.083073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] PATH_INFO: `/v3/projects/e3190fa14de04de9a45ca865146392b8/users/8d6bff9bd0794b0183df4a0ab422a065/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.097097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3190fa14de04de9a45ca865146392b8, user_id=8d6bff9bd0794b0183df4a0ab422a065, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.098327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:28.098327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:00:28.098327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:00:28.100271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.114603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 752/1501] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:00:28 2022] PUT /identity/v3/projects/e3190fa14de04de9a45ca865146392b8/users/8d6bff9bd0794b0183df4a0ab422a065/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:00:28.128302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acdd6c-2293-4edb-b80b-041cff0fa0cc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.128587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acdd6c-2293-4edb-b80b-041cff0fa0cc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.128861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75acdd6c-2293-4edb-b80b-041cff0fa0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.155174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-75acdd6c-2293-4edb-b80b-041cff0fa0cc None None] MFA Rules not processed for user `8d6bff9bd0794b0183df4a0ab422a065`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:00:28.156368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-75acdd6c-2293-4edb-b80b-041cff0fa0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:28.217223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 750/1502] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:00:28.229114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.310377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8b7e-7831-47c6-af32-fa3db51cf41c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.316646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.317288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.317575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.317850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.325910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.327550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.336303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 753/1503] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:00:28.411645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ecdd-b21c-4e1e-9164-e3d328046791 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.411940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ecdd-b21c-4e1e-9164-e3d328046791 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.412216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27ecdd-b21c-4e1e-9164-e3d328046791 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.413935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 751/1504] 10.222.0.46 () {52 vars in 829 bytes} [Fri Apr 1 10:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:00:28.417892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.486337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303846-0fd5-4fd2-bec3-dd110f0bdd41 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.491276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.492181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.493019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.493019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] PATH_INFO: `/v3/users/8d6bff9bd0794b0183df4a0ab422a065` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.493977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6bff9bd0794b0183df4a0ab422a065)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.495029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:28.495029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:00:28.495029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:00:28.496293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.564323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6bff9bd0794b0183df4a0ab422a065'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:28.565168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6bff9bd0794b0183df4a0ab422a065'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:28.577417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6bff9bd0794b0183df4a0ab422a065'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:28.595589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6bff9bd0794b0183df4a0ab422a065'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:28.607802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6bff9bd0794b0183df4a0ab422a065'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:28.614107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 754/1505] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:00:28 2022] DELETE /identity/v3/users/8d6bff9bd0794b0183df4a0ab422a065 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:00:28.618685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.619006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.619283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.636860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:00:28.638077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:28.697277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 752/1506] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:00:28.709569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:28.712025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:28.771784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5373cf-553b-4fd5-aede-b44de9472f83 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:28.777174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:28.778113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:28.778560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:28.779045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:28.793907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:28.795501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa2aee-4f19-4173-8fda-c16ddf6ce710 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:28.805028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 755/1507] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:00:29.155536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:00:29.157146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:00:29.169544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953f834-6d20-4a26-9eb6-30c0bb0e4696 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:00:29.175992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:00:29.176866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:00:29.177207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:00:29.177411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] PATH_INFO: `/v3/projects/e3190fa14de04de9a45ca865146392b8` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:00:29.179453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3190fa14de04de9a45ca865146392b8)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:00:29.180677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:00:29.180677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:00:29.180677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:00:29.181893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:00:29.243638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3190fa14de04de9a45ca865146392b8', 'request_id': 'req-ec0cd535-361a-4653-af63-75f9d036aaa8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:29.249580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3190fa14de04de9a45ca865146392b8', 'request_id': 'req-ec0cd535-361a-4653-af63-75f9d036aaa8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:29.262577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3190fa14de04de9a45ca865146392b8', 'request_id': 'req-ec0cd535-361a-4653-af63-75f9d036aaa8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:29.278040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] The token cache is being invalidate because project e3190fa14de04de9a45ca865146392b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:00:29.278323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:29.279178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ec0cd535-361a-4653-af63-75f9d036aaa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:00:29.280710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 753/1508] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:00:29 2022] DELETE /identity/v3/projects/e3190fa14de04de9a45ca865146392b8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:02:02.205154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:02.205760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:02.205760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:02.208454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 756/1509] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 10:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:02.216137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2f55-1e79-4c5f-8b7c-a62fd8b469cc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:02.216652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2f55-1e79-4c5f-8b7c-a62fd8b469cc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:02.216764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2f55-1e79-4c5f-8b7c-a62fd8b469cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:02.243129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-948b2f55-1e79-4c5f-8b7c-a62fd8b469cc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:02.244375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-948b2f55-1e79-4c5f-8b7c-a62fd8b469cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:02.305363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 754/1510] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 10:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:02.461991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:02.465063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:02.542978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f4fdd-a665-46d1-88ce-935227cfa1e7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:02.548993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:02.549632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:02.549921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:02.550188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:02.558443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:02.560062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70ee77-d5cd-4b76-b43d-9ae8878587ca service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:02.569376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 757/1511] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:03.404768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c17a-d37e-4b65-96f9-2aa44a9ade1e None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:03.405345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c17a-d37e-4b65-96f9-2aa44a9ade1e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:03.405345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c17a-d37e-4b65-96f9-2aa44a9ade1e None None] PATH_INFO: `/v3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:03.406675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 755/1512] 10.222.0.15 () {54 vars in 925 bytes} [Fri Apr 1 10:02:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:02:03.434998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce701ca-1197-49bd-b229-f04557c951bc None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:03.435483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce701ca-1197-49bd-b229-f04557c951bc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:03.435587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce701ca-1197-49bd-b229-f04557c951bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:03.455260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3ce701ca-1197-49bd-b229-f04557c951bc None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:03.456423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3ce701ca-1197-49bd-b229-f04557c951bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:03.520224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 758/1513] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Apr 1 10:02:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:03.847099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6eba-4d27-4f4a-98d8-bcd851a9e575 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:03.847582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6eba-4d27-4f4a-98d8-bcd851a9e575 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:03.848051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c6eba-4d27-4f4a-98d8-bcd851a9e575 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:03.851110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 10:02:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:03.856226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805f9c-6b8e-4739-93d9-aa3b6c77d7d9 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:03.856522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805f9c-6b8e-4739-93d9-aa3b6c77d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:03.856801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805f9c-6b8e-4739-93d9-aa3b6c77d7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:03.876922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-58805f9c-6b8e-4739-93d9-aa3b6c77d7d9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:03.878147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-58805f9c-6b8e-4739-93d9-aa3b6c77d7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:03.887209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 10:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:04.035686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c6eba-4d27-4f4a-98d8-bcd851a9e575 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:04.061984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c6eba-4d27-4f4a-98d8-bcd851a9e575 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:04.071242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:04.071817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:04.072098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:04.072371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:04.081016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:04.082612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67603e-5412-436f-b8e8-2f2bf6e39a51 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:04.091933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 757/1516] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:07.501555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c71b1-7792-4e35-9cc7-02ba8b34af3c None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:07.502158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c71b1-7792-4e35-9cc7-02ba8b34af3c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:07.502158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c71b1-7792-4e35-9cc7-02ba8b34af3c None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:07.504058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 760/1517] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 10:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:07.511986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff064-262f-4e4b-9642-3b18a965c018 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:07.512790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff064-262f-4e4b-9642-3b18a965c018 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:07.512923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bff064-262f-4e4b-9642-3b18a965c018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:07.535289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-19bff064-262f-4e4b-9642-3b18a965c018 None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:07.536486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-19bff064-262f-4e4b-9642-3b18a965c018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:07.547406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 758/1518] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 10:02:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:07.555525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c71b1-7792-4e35-9cc7-02ba8b34af3c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:07.575012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c71b1-7792-4e35-9cc7-02ba8b34af3c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:07.581123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:07.581765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:07.582042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:07.582323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:07.591177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:07.592782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e967e01-a9eb-4d6b-955a-2eb6bbc26d2d service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:07.602764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 761/1519] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:15.782446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691482c-0e7d-4cf5-96f4-1cdd95ccd9b0 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:15.783400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691482c-0e7d-4cf5-96f4-1cdd95ccd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:15.783400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691482c-0e7d-4cf5-96f4-1cdd95ccd9b0 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:15.786248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 759/1520] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 10:02:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:15.791348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17579-cb78-4c5b-8bcb-9f6b190b3021 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:15.791793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17579-cb78-4c5b-8bcb-9f6b190b3021 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:15.791899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17579-cb78-4c5b-8bcb-9f6b190b3021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:15.813199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-25a17579-cb78-4c5b-8bcb-9f6b190b3021 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:15.814422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-25a17579-cb78-4c5b-8bcb-9f6b190b3021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:15.823494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 762/1521] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 10:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:15.982141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691482c-0e7d-4cf5-96f4-1cdd95ccd9b0 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:16.007513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691482c-0e7d-4cf5-96f4-1cdd95ccd9b0 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:16.014102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:16.014801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:16.015081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:16.015351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:16.024176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:16.026074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797a81-0947-49ad-8a47-d69861df2e55 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:16.035759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 760/1522] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:17.283535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ef8-71c4-4f45-8775-d7cb6a15b40d None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:17.284093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ef8-71c4-4f45-8775-d7cb6a15b40d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:17.284093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff379ef8-71c4-4f45-8775-d7cb6a15b40d None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:17.285941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 763/1523] 127.0.0.1 () {54 vars in 901 bytes} [Fri Apr 1 10:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:17.291163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ac9-d2be-4d74-be66-5fc2fb32691d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:17.291680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ac9-d2be-4d74-be66-5fc2fb32691d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:17.291680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef49ac9-d2be-4d74-be66-5fc2fb32691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:17.312047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0ef49ac9-d2be-4d74-be66-5fc2fb32691d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:17.313306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0ef49ac9-d2be-4d74-be66-5fc2fb32691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:17.322010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 761/1524] 127.0.0.1 () {58 vars in 998 bytes} [Fri Apr 1 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:02:17.477628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379ef8-71c4-4f45-8775-d7cb6a15b40d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:17.493268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff379ef8-71c4-4f45-8775-d7cb6a15b40d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:17.498735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:17.499398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:17.499682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:17.499958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:17.508573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:17.510153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5bbca1-7f32-4aa7-baa0-f551a258532b service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:17.519588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 764/1525] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:21.656140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:21.656994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:21.656994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:21.660045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 762/1526] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 10:02:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:21.668662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19979f-ae6e-4742-b448-29000f4ba38c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:21.669100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19979f-ae6e-4742-b448-29000f4ba38c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:21.669238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19979f-ae6e-4742-b448-29000f4ba38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:21.692401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5a19979f-ae6e-4742-b448-29000f4ba38c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:21.693640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5a19979f-ae6e-4742-b448-29000f4ba38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:21.702708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 765/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:21.738204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:21.740544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:21.803040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ab59-3a2e-400f-983a-8d29b2d8b58b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:21.807488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:21.808143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:21.808421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:21.808690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:21.818478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:21.820041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650e3a-5c16-4bbd-8458-b30e3079e801 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:21.829316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 763/1528] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:24.095796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a35-ff85-480d-8ddc-9d2eea0c174e None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:24.096401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a35-ff85-480d-8ddc-9d2eea0c174e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:24.096401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f4a35-ff85-480d-8ddc-9d2eea0c174e None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:24.098132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 766/1529] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 10:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:24.104549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467814-24b6-420d-9b87-921513f0fd2d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:24.105291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467814-24b6-420d-9b87-921513f0fd2d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:24.105397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467814-24b6-420d-9b87-921513f0fd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:24.125929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4f467814-24b6-420d-9b87-921513f0fd2d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:24.127185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4f467814-24b6-420d-9b87-921513f0fd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:24.137065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 764/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:24.173115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4a35-ff85-480d-8ddc-9d2eea0c174e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:24.189470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f4a35-ff85-480d-8ddc-9d2eea0c174e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:24.193689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:24.194342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:24.194617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:24.194920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:24.204131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:24.205570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64146996-7d7c-49aa-a7c7-cd94c48e0663 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:24.217913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 767/1531] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:02:27.946597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:27.947189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:27.947189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:27.950006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 765/1532] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 10:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:27.958836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b724-40d6-4f59-9525-5b99855b2a47 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:27.959298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b724-40d6-4f59-9525-5b99855b2a47 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:27.959400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9b724-40d6-4f59-9525-5b99855b2a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:27.983551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c9a9b724-40d6-4f59-9525-5b99855b2a47 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:27.984761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c9a9b724-40d6-4f59-9525-5b99855b2a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:27.993569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 768/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:28.250952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:28.253001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:28.318908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb94d7-1d89-4f00-b3eb-2c69e1d5b6a6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:28.324408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:28.325227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:28.325535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:28.325851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:28.337630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:28.339099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4cee87-4c49-4318-932f-156b1d1bec42 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:28.348364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 766/1534] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:02:30.664594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb4c9f-75ec-4029-a608-6bb6a2c13ddb None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:30.665385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb4c9f-75ec-4029-a608-6bb6a2c13ddb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:30.665385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb4c9f-75ec-4029-a608-6bb6a2c13ddb None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:30.668119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 769/1535] 127.0.0.1 () {54 vars in 916 bytes} [Fri Apr 1 10:02:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:30.676812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12d-efec-45ed-995c-73d913b88b66 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:30.677536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12d-efec-45ed-995c-73d913b88b66 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:30.677536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12d-efec-45ed-995c-73d913b88b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:30.695987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f5ceb12d-efec-45ed-995c-73d913b88b66 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:30.697166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f5ceb12d-efec-45ed-995c-73d913b88b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:30.705134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 767/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Apr 1 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:30.955545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b0dc-c87b-4004-811a-122f29e38194 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:30.955830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b0dc-c87b-4004-811a-122f29e38194 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:30.956115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8b0dc-c87b-4004-811a-122f29e38194 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:30.957899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 770/1537] 10.222.0.46 () {54 vars in 962 bytes} [Fri Apr 1 10:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:02:30.965735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddedc4-2141-4741-b854-1b3c340aabba None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:30.966141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddedc4-2141-4741-b854-1b3c340aabba None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:30.966541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddedc4-2141-4741-b854-1b3c340aabba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:30.990842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-87ddedc4-2141-4741-b854-1b3c340aabba None None] MFA Rules not processed for user `a1ac29fcbcdc4bcfacfa2695a3bba6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:02:30.992033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-87ddedc4-2141-4741-b854-1b3c340aabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:02:30.999732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 768/1538] 10.222.0.46 () {58 vars in 1059 bytes} [Fri Apr 1 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:02:31.009196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8b0dc-c87b-4004-811a-122f29e38194 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:02:31.021273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8b0dc-c87b-4004-811a-122f29e38194 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:02:31.026076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:02:31.026739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:02:31.027017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:02:31.027285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:02:31.036596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:02:31.038051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abc15c-b589-4bd3-b5f8-63c337211617 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:02:31.047480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 771/1539] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:03:56.926686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47341c3-68a0-4e3d-856d-4180935c94bd None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:56.927333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47341c3-68a0-4e3d-856d-4180935c94bd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:56.927333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47341c3-68a0-4e3d-856d-4180935c94bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:56.951228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f47341c3-68a0-4e3d-856d-4180935c94bd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:56.952787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f47341c3-68a0-4e3d-856d-4180935c94bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:56.965879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 769/1540] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:56.975490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124729-4680-403a-a718-53dcb9902a39 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:56.976108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124729-4680-403a-a718-53dcb9902a39 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:56.976108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124729-4680-403a-a718-53dcb9902a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.001396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ef5d-6795-41ab-8203-4bc609f95875 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.001756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ef5d-6795-41ab-8203-4bc609f95875 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.001941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ef5d-6795-41ab-8203-4bc609f95875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.004687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-33124729-4680-403a-a718-53dcb9902a39 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.007147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-33124729-4680-403a-a718-53dcb9902a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.025796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 772/1541] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.030353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124729-4680-403a-a718-53dcb9902a39 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.030912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-abd9ef5d-6795-41ab-8203-4bc609f95875 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.032478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-abd9ef5d-6795-41ab-8203-4bc609f95875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.045459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 770/1542] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.047554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124729-4680-403a-a718-53dcb9902a39 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.055482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.056177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.056462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.056740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.057477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.057895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.058022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.058509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.058959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:03:57.058959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:03:57.058959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:03:57.059618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.060000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.086866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.088483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.089303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 773/1543] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:03:57.097740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.102082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 771/1544] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:03:57.106921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.116072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0d1a-09ab-4cb5-a87c-70d2b18cab00 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.120265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1a332-838d-47a4-aa38-347b9a8caf7d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.130337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.131608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.131957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.132373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.132631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.132916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.133192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.133491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.133889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.134676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.135214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.136191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.137305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55e5e6-75fe-4b06-abbe-b64959907c6d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.152661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 772/1545] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:57.154079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.154447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.154816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.186814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 774/1546] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:03:57.187662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.192181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.193542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.304136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8edfbc-a002-4ad5-882f-173c3adc0fdf admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.304373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 773/1547] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.304798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.315322 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdecf77-9d4f-4a35-b496-708f275d1d4a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.323412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.324112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.324398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.324687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.325373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.327340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.327536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.328156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.328447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.328847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.329565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.331778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5447-ad76-43c7-bf2d-e15bf5a44528 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.368422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 774/1548] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:57.369707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.370005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.370283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.383429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 775/1549] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:57.384333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.410815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.412100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.515958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507c712-c0d6-4837-8c55-35af84ee4af8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.524440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.525134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.525416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.525692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.526586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.528843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f5abf-f99b-4a8b-9f7b-d29dcd3b3134 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.536385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 775/1550] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.537600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.548097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 776/1551] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:57.549022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca423a2-4375-4a08-a323-9590d21ad363 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.549309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca423a2-4375-4a08-a323-9590d21ad363 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.549581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca423a2-4375-4a08-a323-9590d21ad363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.553147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ce004-8cce-4c0a-a13b-5c489bacad5d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.559112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.560086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.560374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.560654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.561466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.563593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff2ba8-1b7d-4be7-89f9-13f2d9e30798 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.571601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7ca423a2-4375-4a08-a323-9590d21ad363 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.572802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7ca423a2-4375-4a08-a323-9590d21ad363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.581058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 777/1552] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.582284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.582570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.582871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.584532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 776/1553] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:57.584532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.584532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.584532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.603414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.604196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.604598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.605385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.612359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 778/1554] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.617360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.617527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 777/1555] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.617527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.626576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ea6d7-22e1-48c9-a052-9d06f1e57eee None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.627273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3985b-32c9-4b55-8551-b3e078812513 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.631189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.631856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.632003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.632129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.632397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.632702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.632990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.633101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.633384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.634141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.634447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.634689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f6cb6-23ea-43d9-932d-e3c00d4337e1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.636141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d04a-fe36-408e-b1e8-027ac4b86629 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.644425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 778/1556] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:57.645726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.646106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.646361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.648278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 779/1557] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:57.649733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cabc-b82e-456e-b46c-b170f73ac42e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.650023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cabc-b82e-456e-b46c-b170f73ac42e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.650299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65cabc-b82e-456e-b46c-b170f73ac42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.664186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.665369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.667806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-cd65cabc-b82e-456e-b46c-b170f73ac42e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.668965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-cd65cabc-b82e-456e-b46c-b170f73ac42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.673660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 779/1558] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.674334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.676895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 780/1559] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.680051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996cf8d-ed1f-4380-84af-0a099e6b0af5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.680579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996cf8d-ed1f-4380-84af-0a099e6b0af5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.681192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996cf8d-ed1f-4380-84af-0a099e6b0af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.684452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20e96-bb8c-4865-96db-e119ce4329e1 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.690049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.690963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.691290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.691612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.692495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.694629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eed95-d273-496e-b0aa-0c12ef6f4f67 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.701861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b996cf8d-ed1f-4380-84af-0a099e6b0af5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.703188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b996cf8d-ed1f-4380-84af-0a099e6b0af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.706324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 780/1560] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:57.707658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.707954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.708233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.711071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 781/1561] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.715806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.716094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.716372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.725539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.726780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.738256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 781/1562] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.738256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.739713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.740909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.744734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65d964-c1f2-4112-abfa-c9c6d8fb95e7 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.749057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.749641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 782/1563] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.749985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.750270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.750469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.750578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] PATH_INFO: `/v3/projects/f9ed36634b764145aa9262d4f5fee7dd/users/33dd36a152a74c1ebd89159285109407/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.760089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac61c4-05f3-4b4d-a916-a30f73665e03 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.764576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ed36634b764145aa9262d4f5fee7dd, user_id=33dd36a152a74c1ebd89159285109407, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.765364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.765650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:03:57.765650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:03:57.765650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:03:57.766012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.766296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.766567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.767282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.767649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15693d9c-60cc-47ac-8e88-7a93cecd125b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.769172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b27287-e9a7-4594-8ad8-237336d2e07e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.782254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 782/1564] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:57 2022] PUT /identity/v3/projects/f9ed36634b764145aa9262d4f5fee7dd/users/33dd36a152a74c1ebd89159285109407/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:57.786023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.786343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.786682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.797120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 783/1565] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:57.798840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.799130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.799403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.806872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.808077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.817729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.819083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.866097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 783/1566] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.867224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.875216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 784/1567] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:57.876018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11996f9-601d-46c2-90ed-16637498d9d7 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.876144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.882609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.883292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.883545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.883827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.884553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.885122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059f163-3e6e-4b4f-a9f9-97b856734812 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.886161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.889774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.890468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.890778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.891054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.891775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.892068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.894054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.896091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 784/1568] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:57.896091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.906269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 785/1569] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:57.906809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1e13-d0a7-47a8-be55-16f61511295c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.907118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.911572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.912224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.912509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.912783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.913513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.913819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.915444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f93b2-0037-47c5-89c8-8edf3f9dac56 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.918470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cb4e8-ad3d-4e3b-845d-22c3b1ce6809 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.923619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.924264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.924535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.924810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.925527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:57.925846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.927459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.927615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 785/1570] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:57.928910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.929326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.930009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.939620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 786/1571] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:57.943541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.953311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df299055-3154-4b9c-9631-09c14c772c19 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.956602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] MFA Rules not processed for user `33dd36a152a74c1ebd89159285109407`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:57.957784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:57.957974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.958627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.958940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.959228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:57.959899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:57.960905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:03:57.960905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:03:57.960905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:03:57.962095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:57.982455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 787/1572] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:57.983411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:57.993011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cb11a-327e-4e8c-85ef-76cfe2175893 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:57.997855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:57.998720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:57.998969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:57.999400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.000173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:58.000494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.002247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.014993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 788/1573] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:58.015857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.026878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9985a56-9199-493d-9e3d-1b303208a3ad admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.029797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 786/1574] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:58.030639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.034773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.035438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.035724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.036079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.036804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:03:58.037112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.038779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.040830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d1a9-20dc-4d1d-bab8-38294d1257b5 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.045232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.046106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.046444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.046751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] PATH_INFO: `/v3/projects/a3b3649989d44826a64e8a7ee24dbf90/users/dd3b377ae39b4f2387db5fb30716aff3/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.050322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 789/1575] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:03:58.051062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.060246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990b3f-c3cb-45b5-9c17-c45088ea3ca8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.061381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b3649989d44826a64e8a7ee24dbf90, user_id=dd3b377ae39b4f2387db5fb30716aff3, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.064096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.064911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.065580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.065865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.066143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.066860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.068940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.078374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 787/1576] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:58 2022] PUT /identity/v3/projects/a3b3649989d44826a64e8a7ee24dbf90/users/dd3b377ae39b4f2387db5fb30716aff3/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:58.082266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.095373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 790/1577] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.099523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.138368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210efa-5a9a-4378-876b-41b081a595ad admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.159123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479f262-3304-43ad-8775-31a9fcda866b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.163878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.164538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.164819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.165091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.165777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.167777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.191463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.192155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.192436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.192727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.193389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.193750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 791/1578] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.194578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.195515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:03:58.195515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:03:58.195515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:03:58.196875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.222366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 788/1579] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.223203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.255805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2deb5-085e-4463-9307-cc07e65277b5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.280723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe16f6-7d67-4c3b-bc21-2c21a32766f5 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.285138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.285806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.286085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.286357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.287081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.288977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.308360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.309042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.309330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.309609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.310343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.312296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.314087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 789/1580] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.315524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.322452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 792/1581] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.323340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.333005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518f57a-e6b7-4df5-a199-a0c5e115b58a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.376407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2c2b-5d28-4a5b-bf57-6978db71ef36 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.381149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.381879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.382224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.382558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.383377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.385321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98d6d6-310d-4e7c-8fa6-53350b5a72be admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.388342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.389002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.389288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.389561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.390302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.392236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.411973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 790/1582] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.413992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.414445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.414956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.418993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 793/1583] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.419876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.432246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:58.433490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:58.479129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1611291-c165-4b3e-925c-9fb092ff04a8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.484205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.484979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.485340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.485684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.486482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.491669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 791/1584] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:58.491831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.491925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.501776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd04f8-21b4-4401-8f5a-49ba26250505 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.507137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.507793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.508082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.508364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.509072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.511045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.516245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 794/1585] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.516245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.526369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1b82-ec00-4fa4-aa5b-f9c958f4f958 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.531191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.531870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.532149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.532424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.533104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.534026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 792/1586] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.534928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.535056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.544300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684c89-74f7-47df-a9b2-2b7c2cf178ab admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.549875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.550553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.551176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.551176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.552285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.554214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.557943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 795/1587] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.563000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.573101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866993b-52bc-4a42-a528-81c89359aeb4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.577586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 793/1588] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.578062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.578375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.578991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.579278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.579556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.580283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.581924 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.587438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b348-d757-409f-a46c-12b78785b5ba admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.591808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.592445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.592729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.592900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 796/1589] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.592999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.593731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.593858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.595649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.603590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819311d-7a2b-4779-887f-8782c300b252 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.609387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.610226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.610483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.610809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.611555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.613424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.615759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 794/1590] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 296 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.619739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.635377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 797/1591] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:58.636426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.645546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820d26e-2235-4d50-b774-484fb7e63172 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.650449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.651125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.651402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.651694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.652405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.653972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.663642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 798/1592] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.664426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.673390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6cdc0-1a3f-41d1-9462-e62c482e22cf admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.677796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e7d4b-30dd-41db-9833-72f0c5e5a70f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.678669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.679430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.679761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.680218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.680943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.681910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.682531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.682721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.683065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.683404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.692300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.693155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 799/1593] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.693725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.696987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.703494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 795/1594] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:03:58.704306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.707760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3be4b-a67a-4d4a-8178-1f1a3c4f5eb8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.712893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.713554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.713823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c9022-46e4-4b40-ad31-431ac4dcd08d service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.713939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.714099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.714859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.716494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.719638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.720343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.720757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.721040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.721790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.723964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.727425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 800/1595] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.728290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.734955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 796/1596] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.735720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.741791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8dfe1-8437-4ddc-9f2e-6cec0b14e2ba admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.745020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b86d2-163b-4593-b569-4d86ee628859 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.746413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.747382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.747665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.747940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] PATH_INFO: `/v3/projects/4073e831952c461bb6bb0e6b1137240b/users/3ca94cdcf3824f56a886b757e41602dd/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.749661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.750323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.750608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.751678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.751678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.753255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.763416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 797/1597] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.764035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.764152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4073e831952c461bb6bb0e6b1137240b, user_id=3ca94cdcf3824f56a886b757e41602dd, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.767091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.775396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824b59-95a3-4d93-83e7-f91d188d0d47 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.782431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 801/1598] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:58 2022] PUT /identity/v3/projects/4073e831952c461bb6bb0e6b1137240b/users/3ca94cdcf3824f56a886b757e41602dd/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:58.783402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.837322 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.838306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.838707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.839044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.839959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.841675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.849043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60d2e-1a7b-4009-94ba-68f9b3dbf221 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.852315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 798/1599] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.853260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.858089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.858504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.858818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.859101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.860223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.861977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.863839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180486ea-10c1-4494-8c90-61e98bd3fea6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.869747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.870511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.870889 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.871231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.872013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.876676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 802/1600] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.876866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.876977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.890248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 799/1601] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.890458 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4538cf-e629-4271-bfaa-c25ad652b563 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.890557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.894557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.895272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.895559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.895879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.896612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.898368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.901344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752512-39d2-46b3-8e9e-631ad971f96a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.906490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.907197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.907586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.907906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.908746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.912580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 803/1602] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.912580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.912803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2187b-fda2-4c72-900f-293173b35b56 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.924340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 800/1603] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:58.924508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61293e-d5e0-4fe0-92ac-53c1b4b888e2 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.924606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.924606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.924606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.928800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:58.929707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:58.929992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:58.930961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] PATH_INFO: `/v3/projects/8d89234069d6434db420e48b859b7675/users/53101af096324a9781a170b36259ac30/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:58.946760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:58.948557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:58.950805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d89234069d6434db420e48b859b7675, user_id=53101af096324a9781a170b36259ac30, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:58.955928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 801/1604] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:58.956569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:58.956777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:58.967445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ab6a-ddfe-4fca-a424-17cb8973fdc6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:58.972139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 804/1605] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:58 2022] PUT /identity/v3/projects/8d89234069d6434db420e48b859b7675/users/53101af096324a9781a170b36259ac30/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:58.973059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.038206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde50719-32bf-44e2-8932-2838f483bcd4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.040613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.041320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.041601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.044028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.044199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.045196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.045309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.045309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.045469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] PATH_INFO: `/v3/projects/984d4a492510482d88f7aec954117969/users/a0661916b4064097a834dcef7e02b3ee/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.046512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.059844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 802/1606] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:59.061078 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.071176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984d4a492510482d88f7aec954117969, user_id=a0661916b4064097a834dcef7e02b3ee, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.074029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.074179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa6f1-382e-4da8-94d2-679176af2ef4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.079054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.081275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.081640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.082768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] PATH_INFO: `/v3/projects/8abd12555c7642749049eaaedec0cbc1/users/d6cc94b4e59c4b3ba507cc2e696e1a37/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.100586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 805/1607] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:58 2022] PUT /identity/v3/projects/984d4a492510482d88f7aec954117969/users/a0661916b4064097a834dcef7e02b3ee/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.101835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.109075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abd12555c7642749049eaaedec0cbc1, user_id=d6cc94b4e59c4b3ba507cc2e696e1a37, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.112183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.129261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 803/1608] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:59 2022] PUT /identity/v3/projects/8abd12555c7642749049eaaedec0cbc1/users/d6cc94b4e59c4b3ba507cc2e696e1a37/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.130600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.195135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38136-bc9a-41cf-9544-5ac38241f464 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.222454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a792413-55bc-4a05-9e9c-ba839b9fc182 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.230431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.231793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.232246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.232596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] PATH_INFO: `/v3/projects/ab5e0bfbafd04b9fbfce6e8f058fe605/users/944323805d914fe29ef2b7dcef3bbbee/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.259372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5e0bfbafd04b9fbfce6e8f058fe605, user_id=944323805d914fe29ef2b7dcef3bbbee, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.262776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.280076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.281644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.282376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.282878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] PATH_INFO: `/v3/projects/737bf029f01047c09ef534090c2161a7/users/2a5c3349ed28485e904d6d6c5098dbdb/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.283571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 804/1609] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:59 2022] PUT /identity/v3/projects/ab5e0bfbafd04b9fbfce6e8f058fe605/users/944323805d914fe29ef2b7dcef3bbbee/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.284741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.303361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=737bf029f01047c09ef534090c2161a7, user_id=2a5c3349ed28485e904d6d6c5098dbdb, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.306202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.323452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 806/1610] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:59 2022] PUT /identity/v3/projects/737bf029f01047c09ef534090c2161a7/users/2a5c3349ed28485e904d6d6c5098dbdb/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.324512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.346719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893316-1d89-4329-b46c-88979ffdb50c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.391845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788cb07-adb0-4758-97e9-711525538f5b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.397003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.397797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.398146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.398679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.399149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.399757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.400027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.400198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.400738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.401868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.410449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.411953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5125b-7791-447f-804b-794244f8b895 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.413624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 807/1611] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:03:59.414568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.425938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45d8e9-68e9-40a1-ab41-1806c14b470a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.430799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.431790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.432288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.433325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] PATH_INFO: `/v3/projects/4e0864755aa14063b5843399eef8abb0/users/ceed44cfe0e14ddda6fcd772fba313b3/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.439399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 805/1612] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:03:59.450341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4fa1-48bb-4d4c-96c8-38fd371c0560 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.450341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4fa1-48bb-4d4c-96c8-38fd371c0560 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.450341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad4fa1-48bb-4d4c-96c8-38fd371c0560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.470328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0864755aa14063b5843399eef8abb0, user_id=ceed44cfe0e14ddda6fcd772fba313b3, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.472989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72bfdcf-6e68-497e-b4ee-0e6216654508 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.477830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-91ad4fa1-48bb-4d4c-96c8-38fd371c0560 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.479761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-91ad4fa1-48bb-4d4c-96c8-38fd371c0560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.490126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 806/1613] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.491620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ade4-43c8-4e8a-8443-30195b0efbc2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.492007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ade4-43c8-4e8a-8443-30195b0efbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.492408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474ade4-43c8-4e8a-8443-30195b0efbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.499199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 808/1614] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:59 2022] PUT /identity/v3/projects/4e0864755aa14063b5843399eef8abb0/users/ceed44cfe0e14ddda6fcd772fba313b3/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.502980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.504017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.504570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.524657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a474ade4-43c8-4e8a-8443-30195b0efbc2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.527473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a474ade4-43c8-4e8a-8443-30195b0efbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.542996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] MFA Rules not processed for user `944323805d914fe29ef2b7dcef3bbbee`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.544368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.601297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 807/1615] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.601297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.601297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.601297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.634860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] MFA Rules not processed for user `2a5c3349ed28485e904d6d6c5098dbdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.636610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.641491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 809/1616] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.642567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.656459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ac40f-7d23-4fe2-b007-ea48badd5624 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.663121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.664169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.664457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.664735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] PATH_INFO: `/v3/projects/8d89234069d6434db420e48b859b7675/users/53101af096324a9781a170b36259ac30/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.666915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d89234069d6434db420e48b859b7675, user_id=53101af096324a9781a170b36259ac30, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.669701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c6244-ab76-4c36-9b5f-de97015d13b5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.681542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 810/1617] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:03:59 2022] PUT /identity/v3/projects/8d89234069d6434db420e48b859b7675/users/53101af096324a9781a170b36259ac30/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:03:59.682980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5470d-aa1f-4b6c-9e43-d1c289cbc508 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.683271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5470d-aa1f-4b6c-9e43-d1c289cbc508 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.683551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5470d-aa1f-4b6c-9e43-d1c289cbc508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.718522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-44b5470d-aa1f-4b6c-9e43-d1c289cbc508 None None] MFA Rules not processed for user `dd3b377ae39b4f2387db5fb30716aff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.720273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-44b5470d-aa1f-4b6c-9e43-d1c289cbc508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.721092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 808/1618] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.724023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.726084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.790800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c051812-aad9-4e9c-844e-1c00be4bebad None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.808445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 811/1619] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.810627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.811295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.811295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.852534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.853520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.853951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.854415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.867397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] MFA Rules not processed for user `ceed44cfe0e14ddda6fcd772fba313b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:03:59.868690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:03:59.923400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.925072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.935661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 809/1620] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:03:59.936628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.937194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 812/1621] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:03:59.938007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:03:59.948308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56493e5-011b-4343-8470-efbf0b8aee21 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.948883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff577c-8de8-45a9-b85a-8516837715ef None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:03:59.952634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.953301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.953587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.953865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.954477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:03:59.955100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.955388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.955718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.956357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.958301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612d96b-76cf-4f9b-9877-73edfcc2edab admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.963742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:03:59.965181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f23266-c1ba-4a32-adf0-0c9c70635ddf service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:03:59.974885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 810/1622] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:03:59.976749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.976749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.976950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.989546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 813/1623] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:03:59.991589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9861d7-b8e6-4ec0-94b8-6866f6950124 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.991991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9861d7-b8e6-4ec0-94b8-6866f6950124 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.992392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9861d7-b8e6-4ec0-94b8-6866f6950124 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:03:59.994119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 814/1624] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 10:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:03:59.995849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:03:59.996235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:03:59.996605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.008568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] MFA Rules not processed for user `53101af096324a9781a170b36259ac30`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:00.010297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:00.016040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] MFA Rules not processed for user `dd3b377ae39b4f2387db5fb30716aff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:00.017358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:00.074682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 815/1625] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:00.079971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.086753 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 811/1626] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:00.089480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.159128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefdef4-453b-40af-a41f-391a8bebea19 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.164316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3fb97-b36c-408d-8094-65b7ed101c9f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.165051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.166104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.166830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.167114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.168136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.173845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1fa0-7244-4722-a387-86037c2fd459 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.177329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.178274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.178778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.179283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.180276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.182666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d0884-69b3-46d4-adbc-0574ce9c2f09 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.213887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 816/1627] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:00 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:00.213887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.214230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.215217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.218861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 812/1628] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:00 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:00.221294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580f2b-12c2-4d87-81ff-7503d8cb701f None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.221584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580f2b-12c2-4d87-81ff-7503d8cb701f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.221862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6580f2b-12c2-4d87-81ff-7503d8cb701f None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.224118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 813/1629] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 10:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:00.225109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580f2b-12c2-4d87-81ff-7503d8cb701f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.248691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:00.250659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:00.325295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6580f2b-12c2-4d87-81ff-7503d8cb701f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.334943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.335652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.335936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.337327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.388395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 817/1630] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:00.402191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.444434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.446016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.462353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 814/1631] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:00.463315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.548571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad939b-080c-4efc-acbb-72d6ba978bc5 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.555075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.556307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.556799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.557520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.558448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.560944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.574727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c479e-ae37-4ebf-9281-c1397ed88161 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.579947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.580770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.581135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.581506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.582335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.584088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03613ceb-722b-4bf8-b1c1-4289f59facfa admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.594380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 818/1632] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:00.594380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.594380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.594380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.602906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 815/1633] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:00 2022] POST /identity/v3/users => generated 308 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:00.606252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.616587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:00.617900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:00.628438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 819/1634] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:00.629441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.639448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7f2d-59f6-447f-ab9e-742736402eab admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.640571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c94bc3-599e-4c28-891a-a52d743dcf3c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.649386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.649701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.649831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.649831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.649831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] PATH_INFO: `/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d/users/99cfea9748844a3596e7e6d4521f577d/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.650087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.650087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.650473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.701987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce851b3fae34a3e965e2f33a9d39d6d, user_id=99cfea9748844a3596e7e6d4521f577d, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.707891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.738798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 820/1635] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:00 2022] PUT /identity/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d/users/99cfea9748844a3596e7e6d4521f577d/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:00.739800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.776387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.778008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.801632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 816/1636] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:00.802507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.829039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101b393-0dd6-4e91-a10c-2ce2703baa5f service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.894698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63954-a4da-4f51-95ec-d503ba38e67c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:00.910207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.911502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.914402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.915181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.916397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:00.918998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:00.955139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 821/1637] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:00.957175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:00.957609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:00.958278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:00.958561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:00.958884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:00.993734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c612b55-544d-45af-824d-32f771c5db0c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.015485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.016205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.017565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.017862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.020994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.024976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.025525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.027665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.041479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 817/1638] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:01.042330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.053608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5d5a5-12a6-42ab-aa42-fdde47797eb5 service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.059311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.060286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.060648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.061008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] PATH_INFO: `/v3/projects/82b3803e401d4404b70e1baffd6d00da/users/1edc138a87fa4ebf8389ca85cd54b333/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.066689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 822/1639] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:01.076333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.078114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3803e401d4404b70e1baffd6d00da, user_id=1edc138a87fa4ebf8389ca85cd54b333, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.080894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.108513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 818/1640] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:01 2022] PUT /identity/v3/projects/82b3803e401d4404b70e1baffd6d00da/users/1edc138a87fa4ebf8389ca85cd54b333/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:01.112842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.112998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01db8-fd78-4b55-a6a7-58166d0286ae admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.216717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490ffe-67e4-43fe-a4c0-50c4a933ffa1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.228915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53101af096324a9781a170b36259ac30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d89234069d6434db420e48b859b7675', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.230302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.230951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.233366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.235351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:01.236034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.241269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.253020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.256831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.257193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.257527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] PATH_INFO: `/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d/users/99cfea9748844a3596e7e6d4521f577d/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.261685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce851b3fae34a3e965e2f33a9d39d6d, user_id=99cfea9748844a3596e7e6d4521f577d, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.275594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b314e3-0075-4b4d-b48b-7849f71a765c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.276072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 819/1641] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:01.279486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.304658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9951-bba4-4992-a2f9-480a7ce2de7f tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.305663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 823/1642] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:01 2022] PUT /identity/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d/users/99cfea9748844a3596e7e6d4521f577d/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:01.307524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023998-5f5e-405c-956f-f089eb2bc9a8 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.308428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023998-5f5e-405c-956f-f089eb2bc9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.308428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43023998-5f5e-405c-956f-f089eb2bc9a8 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.312297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 824/1643] 10.222.0.46 () {54 vars in 912 bytes} [Fri Apr 1 10:04:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:01.313034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023998-5f5e-405c-956f-f089eb2bc9a8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.432605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.433535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.433932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.434273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.435128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.436915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc47c5f-9c58-4127-9d72-69b67f8bc4c6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.450268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 820/1644] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:01.451825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa5db-a6ee-4858-a5ae-a30221e604be None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.452180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa5db-a6ee-4858-a5ae-a30221e604be None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.452617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa5db-a6ee-4858-a5ae-a30221e604be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.455187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43023998-5f5e-405c-956f-f089eb2bc9a8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.463960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53101af096324a9781a170b36259ac30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d89234069d6434db420e48b859b7675', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.465300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.465692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.466073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.466932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.471551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bbf93-f3f5-443b-ac01-f576865ba90e tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.494847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2e9fa5db-a6ee-4858-a5ae-a30221e604be None None] MFA Rules not processed for user `99cfea9748844a3596e7e6d4521f577d`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:01.496383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2e9fa5db-a6ee-4858-a5ae-a30221e604be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:01.520145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 825/1645] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:01 2022] POST /identity/v3/projects => generated 355 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:01.523036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.523504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.524305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.577895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:01.579501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:01.611248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 821/1646] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:01.613689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a35ed-d198-4645-8c57-6cd720753119 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.614704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a35ed-d198-4645-8c57-6cd720753119 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.615173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a35ed-d198-4645-8c57-6cd720753119 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.622170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 822/1647] 10.222.0.46 () {54 vars in 912 bytes} [Fri Apr 1 10:04:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:01.624093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a35ed-d198-4645-8c57-6cd720753119 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.688290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 826/1648] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:01.690399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.702219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a35ed-d198-4645-8c57-6cd720753119 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.708009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.709479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.710105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.710563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] PATH_INFO: `/v3/projects/82b3803e401d4404b70e1baffd6d00da/users/1edc138a87fa4ebf8389ca85cd54b333/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.713397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b3803e401d4404b70e1baffd6d00da, user_id=1edc138a87fa4ebf8389ca85cd54b333, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.717092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.732148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 823/1649] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:01 2022] PUT /identity/v3/projects/82b3803e401d4404b70e1baffd6d00da/users/1edc138a87fa4ebf8389ca85cd54b333/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:01.733511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:01.788552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d5c40-46c4-4004-a93c-a8a5a9d5eb9a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.859969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7664-2a9a-4663-9b51-133cf7a8096d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:01.869150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.870251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.870634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.871023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.876133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53101af096324a9781a170b36259ac30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d89234069d6434db420e48b859b7675', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:01.877237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.877237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.877452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.878141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:01.878506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.880643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb991c-e107-4fce-967b-94c3defbdad6 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:01.904592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 827/1650] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:01.906389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bd36-dc39-4eca-a38c-add5a9b4ffa1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:01.906716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bd36-dc39-4eca-a38c-add5a9b4ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:01.907002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9bd36-dc39-4eca-a38c-add5a9b4ffa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:01.944634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-88c9bd36-dc39-4eca-a38c-add5a9b4ffa1 None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:01.950086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-88c9bd36-dc39-4eca-a38c-add5a9b4ffa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:01.978976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:01.981198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:02.005356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 824/1651] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:02.008606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:02.031061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad377ef9-f5b3-4979-99e0-19126b38b4b0 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:02.042798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:02.045136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:02.045432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:02.045740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:02.064312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 828/1652] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:02.067013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:02.067336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:02.067583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:02.084543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:02.086040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:02.129853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 825/1653] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:02.131144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:02.134460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] MFA Rules not processed for user `1edc138a87fa4ebf8389ca85cd54b333`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:02.135954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:02.137436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:02.259475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ce803-1215-4da4-bb6e-72e0f5fd1763 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:02.269887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:02.270683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:02.271492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:02.271772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:02.298263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:02.299755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:02.308790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 829/1654] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:02.309686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:02.337718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 826/1655] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:02.339621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:02.339846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08471b6-2efe-4185-96d1-de7abc8f6e7f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:02.345316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53101af096324a9781a170b36259ac30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d89234069d6434db420e48b859b7675', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:02.346206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:02.346491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:02.346802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] PATH_INFO: `/v3/projects/41038699edfc4778908043922d100216` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:02.348549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41038699edfc4778908043922d100216)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:02.349844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: WARNING py.warnings [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:04:02.349844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: warnings.warn(msg) Apr 01 10:04:02.349844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: Apr 01 10:04:02.351076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:02.365055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a2202-0af0-4e3b-851b-8ca9b8c48cdc service glance] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:02.370051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:02.373109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:02.374089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:02.374558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:02.478891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:02.483923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:02.505563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 827/1656] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:02.506784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41038699edfc4778908043922d100216', 'request_id': 'req-0d04f646-046e-4753-91dc-a127730b7449'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:02.515938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41038699edfc4778908043922d100216', 'request_id': 'req-0d04f646-046e-4753-91dc-a127730b7449'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:02.545158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41038699edfc4778908043922d100216', 'request_id': 'req-0d04f646-046e-4753-91dc-a127730b7449'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:02.566111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] The token cache is being invalidate because project 41038699edfc4778908043922d100216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:02.566743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:02.567640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0d04f646-046e-4753-91dc-a127730b7449 tempest-VolumeQuotaClassesTest-747709115 tempest-VolumeQuotaClassesTest-747709115-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:02.570591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 830/1657] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:02 2022] DELETE /identity/v3/projects/41038699edfc4778908043922d100216 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:03.039658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:03.055434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3094-770c-4c83-b3ba-29fb2368a5c1 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:03.123628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:03.124411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:03.124756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:03.125042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:03.127236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:03.275676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:03.277379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60502680-0525-4c3b-ae97-b3311d194ecb service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:03.315261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 828/1658] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:03 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:03.752509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:03.753002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:03.753252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:03.755435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 831/1659] 10.222.0.46 () {54 vars in 912 bytes} [Fri Apr 1 10:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:03.761195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920cb5e-6733-449f-8744-3059d885998b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:03.761602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920cb5e-6733-449f-8744-3059d885998b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:03.761972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920cb5e-6733-449f-8744-3059d885998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:03.859506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e920cb5e-6733-449f-8744-3059d885998b None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:03.860761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e920cb5e-6733-449f-8744-3059d885998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:03.870678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:03.872878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:03.981374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 829/1660] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:04:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:03.982391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920cb5e-6733-449f-8744-3059d885998b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:03.984024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e920cb5e-6733-449f-8744-3059d885998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.043280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be193c-6362-4b69-8054-02d12643bb82 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:04.055406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:04.056525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.056810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.057082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] PATH_INFO: `/v3/users/ceed44cfe0e14ddda6fcd772fba313b3` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.059392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceed44cfe0e14ddda6fcd772fba313b3)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:04.065430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:04.141099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920cb5e-6733-449f-8744-3059d885998b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:04.169138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:04.170312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.170603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.170896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] PATH_INFO: `/v3/users/33dd36a152a74c1ebd89159285109407` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.172824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dd36a152a74c1ebd89159285109407)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:04.175106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: WARNING py.warnings [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:04:04.175106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: warnings.warn(msg) Apr 01 10:04:04.175106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: Apr 01 10:04:04.176863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:04.192258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceed44cfe0e14ddda6fcd772fba313b3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.194869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceed44cfe0e14ddda6fcd772fba313b3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.210640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceed44cfe0e14ddda6fcd772fba313b3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.236118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceed44cfe0e14ddda6fcd772fba313b3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.264218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dd36a152a74c1ebd89159285109407'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.276493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dd36a152a74c1ebd89159285109407'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.278037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceed44cfe0e14ddda6fcd772fba313b3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.291397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 832/1661] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:03 2022] DELETE /identity/v3/users/ceed44cfe0e14ddda6fcd772fba313b3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:04.294568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:04.311534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.313421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dd36a152a74c1ebd89159285109407'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.314330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dd36a152a74c1ebd89159285109407'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.315030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-dc271da2-3401-46d6-b726-832e6e26f5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dd36a152a74c1ebd89159285109407'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:04.338253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 830/1662] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:03 2022] DELETE /identity/v3/users/33dd36a152a74c1ebd89159285109407 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:04.343191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d258-74b7-4664-91f2-ad928d46861c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.343662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d258-74b7-4664-91f2-ad928d46861c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.344013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57d258-74b7-4664-91f2-ad928d46861c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.368734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ea57d258-74b7-4664-91f2-ad928d46861c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:04.370062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ea57d258-74b7-4664-91f2-ad928d46861c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.469035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 831/1663] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:04.471264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.471625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.472213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.498353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570fd2-03cc-4bb0-b062-74266294b3f0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:04.503396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:04.504573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.523268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 832/1664] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:04.525239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:04.528239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.600070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c5c3-b4a6-4c76-8c99-cb6498232168 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:04.603856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:04.604893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.605249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.605735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.617917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:04.620905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:04.634971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 833/1665] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:04.636234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:04.640626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:04.641317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.641602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.641882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.645125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36299-3028-4055-b117-ca48bd31aff5 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:04.651080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:04.654996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:04.657008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:04.657382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:04.657749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:04.668241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:04.670587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458a3b3-c9e2-47ae-af6f-db523dc4334e service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:04.670890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:04.672509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1da33-6335-4234-bde1-aa19c7195229 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:04.687135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 833/1666] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:04.694477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 834/1667] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:06.107801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685fe1-800b-42fc-add0-41bfb29ed5f5 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.108509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685fe1-800b-42fc-add0-41bfb29ed5f5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.108509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35685fe1-800b-42fc-add0-41bfb29ed5f5 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.110843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 834/1668] 10.222.0.46 () {54 vars in 960 bytes} [Fri Apr 1 10:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:06.118934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.119564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.119564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.151125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] MFA Rules not processed for user `31d9c1639edd4e40a16ad8809dc20353`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:06.159139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.281477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 835/1669] 10.222.0.46 () {58 vars in 1057 bytes} [Fri Apr 1 10:04:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:06.289654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685fe1-800b-42fc-add0-41bfb29ed5f5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:06.312577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35685fe1-800b-42fc-add0-41bfb29ed5f5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:06.331444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:06.332125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.332406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.332683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.339467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.383065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:06.388656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b565c9-b43f-4dcd-bd0e-5da9652df690 service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:06.398040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:06.399956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.413359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 835/1670] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:06.446436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a9c3-7ee6-4883-abf8-8eac43d50281 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:06.453143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:06.454072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.454352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.454627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] PATH_INFO: `/v3/users/2a5c3349ed28485e904d6d6c5098dbdb` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.455879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5c3349ed28485e904d6d6c5098dbdb)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:06.458067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:06.545171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5c3349ed28485e904d6d6c5098dbdb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:06.549464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5c3349ed28485e904d6d6c5098dbdb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:06.576036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5c3349ed28485e904d6d6c5098dbdb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:06.576956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5c3349ed28485e904d6d6c5098dbdb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:06.577763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5c3349ed28485e904d6d6c5098dbdb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:06.603329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 836/1671] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:06 2022] DELETE /identity/v3/users/2a5c3349ed28485e904d6d6c5098dbdb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:06.607822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.608397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.608831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.643531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:06.644938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.784513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 836/1672] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:06.807092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:06.809041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.953873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:06.955527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:06.956496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952e6a5-bbf6-40f8-84a2-15b17028447c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:06.964458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:06.966355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:06.966672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:06.968143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:06.986709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddc612-3987-4919-82db-1bd282ed53dd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:06.995351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:06.998486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:07.004008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:07.004982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:07.005398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:07.005770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] PATH_INFO: `/v3/projects/f9ed36634b764145aa9262d4f5fee7dd` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:07.009403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ed36634b764145aa9262d4f5fee7dd)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:07.024997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 837/1673] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:07.067287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:07.074974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:07.074974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:07.074974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ebd0a-fea2-46ef-9453-fc048b1a1958 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:07.083769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:07.084673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:07.085873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:07.086166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] PATH_INFO: `/v3/projects/4e0864755aa14063b5843399eef8abb0` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:07.091755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0864755aa14063b5843399eef8abb0)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:07.093737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:07.193686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ed36634b764145aa9262d4f5fee7dd', 'request_id': 'req-78aca0ec-2d16-4f00-b47b-34f68f7a6060'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.197574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0864755aa14063b5843399eef8abb0', 'request_id': 'req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.210512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ed36634b764145aa9262d4f5fee7dd', 'request_id': 'req-78aca0ec-2d16-4f00-b47b-34f68f7a6060'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.215874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0864755aa14063b5843399eef8abb0', 'request_id': 'req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.224632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0864755aa14063b5843399eef8abb0', 'request_id': 'req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.224822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ed36634b764145aa9262d4f5fee7dd', 'request_id': 'req-78aca0ec-2d16-4f00-b47b-34f68f7a6060'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.248686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] The token cache is being invalidate because project 4e0864755aa14063b5843399eef8abb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:07.249038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.249735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.253294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 838/1674] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:07 2022] DELETE /identity/v3/projects/4e0864755aa14063b5843399eef8abb0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:07.254459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] The token cache is being invalidate because project f9ed36634b764145aa9262d4f5fee7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:07.254927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.256255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.257072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:07.259349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:07.263772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 837/1675] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:06 2022] DELETE /identity/v3/projects/f9ed36634b764145aa9262d4f5fee7dd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:07.267639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:07.269273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:07.412389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c02a8-ba56-4f04-ab4e-ff31a152a8ff admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:07.421442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:07.422399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:07.422759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:07.422983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] PATH_INFO: `/v3/users/1edc138a87fa4ebf8389ca85cd54b333` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:07.425304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edc138a87fa4ebf8389ca85cd54b333)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:07.428416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:07.451460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aca0ec-2d16-4f00-b47b-34f68f7a6060 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:07.457092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:07.458274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:07.458772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:07.459209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] PATH_INFO: `/v3/users/53101af096324a9781a170b36259ac30` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:07.460683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53101af096324a9781a170b36259ac30)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:07.463951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:07.517260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53101af096324a9781a170b36259ac30'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.518371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53101af096324a9781a170b36259ac30'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.549411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53101af096324a9781a170b36259ac30'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.565965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53101af096324a9781a170b36259ac30'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.576347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53101af096324a9781a170b36259ac30'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.585337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 838/1676] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:07 2022] DELETE /identity/v3/users/53101af096324a9781a170b36259ac30 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:07.604015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edc138a87fa4ebf8389ca85cd54b333'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.619049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edc138a87fa4ebf8389ca85cd54b333'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.647851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edc138a87fa4ebf8389ca85cd54b333'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.650428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edc138a87fa4ebf8389ca85cd54b333'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.653668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6657e10f-6da7-4ec8-8e0d-15e819d50cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edc138a87fa4ebf8389ca85cd54b333'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:07.694982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 839/1677] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:07 2022] DELETE /identity/v3/users/1edc138a87fa4ebf8389ca85cd54b333 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:07.854226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:07.856834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:08.074936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55a5a7-fb69-4a8c-b5cc-3603beb2bb46 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:08.240062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:08.241073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:08.241341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:08.241789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] PATH_INFO: `/v3/users/944323805d914fe29ef2b7dcef3bbbee` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:08.243277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=944323805d914fe29ef2b7dcef3bbbee)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:08.245479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:08.335088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944323805d914fe29ef2b7dcef3bbbee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:08.336167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944323805d914fe29ef2b7dcef3bbbee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:08.351757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944323805d914fe29ef2b7dcef3bbbee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:08.367800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944323805d914fe29ef2b7dcef3bbbee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:08.376135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944323805d914fe29ef2b7dcef3bbbee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:08.383956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 839/1678] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:07 2022] DELETE /identity/v3/users/944323805d914fe29ef2b7dcef3bbbee => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:08.388569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:08.389065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:08.389131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:08.419180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:08.420539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:08.577556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 840/1679] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:08.633168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:08.635381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:08.767722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a3930-7518-4fb9-9a98-0cfcbd5e24ff admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:08.776294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:08.777177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:08.777287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:08.777542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:08.801457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:08.803711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf658a-4e60-4fb5-823a-19c3a50e03dc service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:08.823354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 840/1680] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:08.937623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:08.939146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:08.958034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed08577-4f85-46b1-8a5a-9e3446a98081 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:08.973080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:08.974001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:08.974289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:08.974566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] PATH_INFO: `/v3/projects/82b3803e401d4404b70e1baffd6d00da` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:08.976397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b3803e401d4404b70e1baffd6d00da)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:08.980094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:09.100484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b3803e401d4404b70e1baffd6d00da', 'request_id': 'req-c35c2601-8730-49d5-8c04-cd1cadf41c52'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:09.121615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b3803e401d4404b70e1baffd6d00da', 'request_id': 'req-c35c2601-8730-49d5-8c04-cd1cadf41c52'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:09.144336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b3803e401d4404b70e1baffd6d00da', 'request_id': 'req-c35c2601-8730-49d5-8c04-cd1cadf41c52'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:09.179237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] The token cache is being invalidate because project 82b3803e401d4404b70e1baffd6d00da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:09.179694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:09.180582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c35c2601-8730-49d5-8c04-cd1cadf41c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:09.183954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 841/1681] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:08 2022] DELETE /identity/v3/projects/82b3803e401d4404b70e1baffd6d00da => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:09.189177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.189474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.189756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.243363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:09.251590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:09.489372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 841/1682] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:09.493919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.494261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.494354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.532257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:09.533689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:09.559139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 842/1683] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:09.565301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:09.578599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f27d2b-edd1-48ab-a38a-ba689c84921c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:09.599972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:09.602952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.603892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.604197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.607193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:09.608205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:09.612585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7ccec-9192-44a5-bce8-ac42b26d4a20 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:09.646143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 842/1684] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:09.651049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:09.669155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a797cf-d36e-4ed0-aab8-bede0dbd138e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:09.681749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:09.682462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.682777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.683056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.683840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:09.685796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:09.713773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.714833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.715261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.740737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:09.741723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 843/1685] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:09 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:09.742737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:09.746040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:09.862717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 843/1686] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:04:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:09.878372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85c2-286f-4a0d-b4c1-7ece0207c1e0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:09.885907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:09.886736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.886992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.887278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.887992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:09.890033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:09.945215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 844/1687] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:09 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:09.949044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:09.968438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82024b-1722-4ad8-a72b-9d061f4abc1b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:09.977845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:09.978951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:09.979242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:09.979718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:09.980604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:09.984425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:09.999732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 844/1688] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:10.002701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.013564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f06720-db38-4ac8-9943-a9cf24eedafd admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.019781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.020677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.021055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.021476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.022320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.024525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.040981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 845/1689] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:10.041628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.059796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616bc8-8144-4b12-8782-5087f1f0f9d0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.067137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.068450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.068739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.069017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] PATH_INFO: `/v3/projects/d809a41b7639455c9fa61884742a5e87/users/e6268b99f79748cbaf5d9615881c9462/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.088775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.091328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:10.103652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d809a41b7639455c9fa61884742a5e87, user_id=e6268b99f79748cbaf5d9615881c9462, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.111925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604a375-0fb3-4aac-bfae-9c94cdd84a74 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.149968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 845/1690] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:10 2022] PUT /identity/v3/projects/d809a41b7639455c9fa61884742a5e87/users/e6268b99f79748cbaf5d9615881c9462/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:10.161136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.161593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.161918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.216978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] MFA Rules not processed for user `e6268b99f79748cbaf5d9615881c9462`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:10.219836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:10.265270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2adf-4083-42f8-b733-7c70ea1b0f09 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.379641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 846/1691] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:10.379641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.383129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:10.425707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.427654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.428581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.429198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.499246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80a279-cbad-4fe3-ad6f-0532ca6d1d25 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.509043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.510291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.510577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.510894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] PATH_INFO: `/v3/projects/737bf029f01047c09ef534090c2161a7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.512141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737bf029f01047c09ef534090c2161a7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.522673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.552841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.554549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.568077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 846/1692] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 01 10:04:10.570495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.597038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf7b2d-da84-4bde-9874-0ed99a2dc738 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.635986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737bf029f01047c09ef534090c2161a7', 'request_id': 'req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:10.656597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737bf029f01047c09ef534090c2161a7', 'request_id': 'req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:10.667973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737bf029f01047c09ef534090c2161a7', 'request_id': 'req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:10.695651 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] The token cache is being invalidate because project 737bf029f01047c09ef534090c2161a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:10.695953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:10.697468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:10.705665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 847/1693] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:10 2022] DELETE /identity/v3/projects/737bf029f01047c09ef534090c2161a7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:10.706861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:10.708736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:10.801479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.802179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.802456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.802779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.803558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.808422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82101c-8701-4ae8-95d5-07f80b7f4dce admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.848562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feed07-e0fd-4429-a3e7-a5f31af0a3f4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:10.861136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:10.862843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.863141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.863420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] PATH_INFO: `/v3/projects/8d89234069d6434db420e48b859b7675` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.867124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d89234069d6434db420e48b859b7675)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:10.869537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 847/1694] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:10.871183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2259b5-8d65-4645-8cb1-6c2d2d500248 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:10.871972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:10.874968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2259b5-8d65-4645-8cb1-6c2d2d500248 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:10.875468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2259b5-8d65-4645-8cb1-6c2d2d500248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:10.920304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0a2259b5-8d65-4645-8cb1-6c2d2d500248 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:10.925512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0a2259b5-8d65-4645-8cb1-6c2d2d500248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:10.989373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d89234069d6434db420e48b859b7675', 'request_id': 'req-77730018-6fa3-4df9-8e9c-be8bf525c8cf'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:11.006673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d89234069d6434db420e48b859b7675', 'request_id': 'req-77730018-6fa3-4df9-8e9c-be8bf525c8cf'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:11.024031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d89234069d6434db420e48b859b7675', 'request_id': 'req-77730018-6fa3-4df9-8e9c-be8bf525c8cf'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:11.050079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] The token cache is being invalidate because project 8d89234069d6434db420e48b859b7675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:11.050396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:11.056478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:11.059417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 848/1695] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:10 2022] DELETE /identity/v3/projects/8d89234069d6434db420e48b859b7675 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:11.064327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.068466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:11.106798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 848/1696] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:11.110974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4126e3-1e7d-4172-b4a7-f937238c8804 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.112527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4126e3-1e7d-4172-b4a7-f937238c8804 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.112963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4126e3-1e7d-4172-b4a7-f937238c8804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.169502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-7b4126e3-1e7d-4172-b4a7-f937238c8804 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:11.171538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7b4126e3-1e7d-4172-b4a7-f937238c8804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:11.311385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77730018-6fa3-4df9-8e9c-be8bf525c8cf admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.337383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.339515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.339807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.340090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.343551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.349478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6da3c-e680-4900-8167-a4fc1f85159d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.359710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 849/1697] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:11.359710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.359710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.359710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.405604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 849/1698] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/users => generated 293 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:11.416131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:11.420918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:11.427574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.430287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.431251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.449310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 850/1699] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:11.459881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.472385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:11.473653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:11.485841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 850/1700] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:11.489177 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.501320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca837a5-4367-4a63-a449-b2552847e7f1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.502416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5540c0-61bd-406b-a50a-5936d71f121a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.525372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.525649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.525938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.526206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.528729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.531606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.532051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.533351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.533662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.537061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:11.537394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.539461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.541861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.557581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 851/1701] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:11.558524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.572517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6ab87-91f9-4670-93f3-51248f52a34b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.597593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 851/1702] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:11.599656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.600377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.600663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.602077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.604588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.609105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:11.609431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.611129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.628746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfde30-fbf1-4bc2-ae81-097638400203 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.637870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.638589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.641167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.642795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.643614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.645696 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 852/1703] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:11.646736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.648261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.669067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee172e-fcd3-4afb-9026-a0bdb5c98650 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.680553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:11.682199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:11.682490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:11.682809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] PATH_INFO: `/v3/projects/e17ff6bdab674f10b7531eb9710fa192/users/1a9ffe4f48474eb9a41b048925e4b077/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:11.711737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 852/1704] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:11.718766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.738779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ff6bdab674f10b7531eb9710fa192, user_id=1a9ffe4f48474eb9a41b048925e4b077, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:11.741812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:11.778061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 853/1705] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:11 2022] PUT /identity/v3/projects/e17ff6bdab674f10b7531eb9710fa192/users/1a9ffe4f48474eb9a41b048925e4b077/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:11.779275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:11.921779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3960a7-bb45-4391-acea-88fc3d938d31 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:11.980951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b651cc-c1bf-459d-9b88-f6f87f77e792 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.007193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.007912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.008189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.008470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.009198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.011403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.100155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 854/1706] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:12.100155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.133479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123168bf-cefa-48b8-a7b5-7a20bc998a6c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.188550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.191375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.191664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.191943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.192763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.194350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.207890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.210829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.211126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.211410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.212139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.214092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.255909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 855/1707] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:12.264915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.320905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca73c-b55c-412e-81f0-4299665183db admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.327984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 853/1708] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:11 2022] POST /identity/v3/projects => generated 393 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:12.328675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.329214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.330200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.331162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.331700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.332706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.334857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.349747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 856/1709] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:12.354707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.365766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc3df-c68f-44c2-b55e-f46c48c5d286 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.517213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.518805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.519309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.519817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.520764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.523425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.565264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 857/1710] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:12 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:12.587005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.599823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a1e61-a013-4547-9ca2-60a4f7b3af10 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.612406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.613342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.614959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.615291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] PATH_INFO: `/v3/projects/e17ff6bdab674f10b7531eb9710fa192/users/1a9ffe4f48474eb9a41b048925e4b077/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.619185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ff6bdab674f10b7531eb9710fa192, user_id=1a9ffe4f48474eb9a41b048925e4b077, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.633029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.635364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a225e1-2b11-45e5-8138-65857cda0fba admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.654637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.660440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.661370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.661919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.664186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.667730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaf467-b6e7-4608-8b01-f58ec42b9406 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.676852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 854/1711] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:12 2022] PUT /identity/v3/projects/e17ff6bdab674f10b7531eb9710fa192/users/1a9ffe4f48474eb9a41b048925e4b077/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:12.678139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.726291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 858/1712] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:12.730095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.741536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.741960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.807199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66984d4c-05d6-41a6-bf86-c4fd96045103 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.837196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.838977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.843835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.845013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:12.850218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:12.862177 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:12.868044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] MFA Rules not processed for user `1a9ffe4f48474eb9a41b048925e4b077`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:12.882492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:12.916372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 855/1713] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:12.916372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:12.956566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb9b22-6dad-45bf-80b5-8623adb9fb78 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:12.973933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:12.974856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:12.975145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:12.984625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] PATH_INFO: `/v3/projects/a0fcfba8ae0b4ec78d3cafc06673ec5a/users/480b3062a1684914896e63a8f7f64881/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:13.052003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0fcfba8ae0b4ec78d3cafc06673ec5a, user_id=480b3062a1684914896e63a8f7f64881, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:13.061091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:13.118009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 856/1714] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:12 2022] PUT /identity/v3/projects/a0fcfba8ae0b4ec78d3cafc06673ec5a/users/480b3062a1684914896e63a8f7f64881/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:13.135419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:13.139998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:13.196646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 859/1715] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:13.197607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:13.244234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67e58f-f177-4191-a8a1-5fc4f1052bee None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:13.403958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4740fb-ff67-4249-9441-0927defadeaf admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:13.430577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:13.431535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:13.431819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:13.432101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] PATH_INFO: `/v3/projects/ab5e0bfbafd04b9fbfce6e8f058fe605` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:13.433630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5e0bfbafd04b9fbfce6e8f058fe605)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:13.435625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:13.511546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:13.512269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:13.512556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:13.512832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:13.513588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:13.515323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dffd2-18ae-4268-9e4c-35d4ee6c86d6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:13.576112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 860/1716] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:13.577618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:13.577855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:13.578134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:13.676265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5e0bfbafd04b9fbfce6e8f058fe605', 'request_id': 'req-41fd218d-d38e-4329-8e25-33fc4e6aa833'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:13.724863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5e0bfbafd04b9fbfce6e8f058fe605', 'request_id': 'req-41fd218d-d38e-4329-8e25-33fc4e6aa833'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:13.728593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] MFA Rules not processed for user `3ca94cdcf3824f56a886b757e41602dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:13.734227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:13.757265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5e0bfbafd04b9fbfce6e8f058fe605', 'request_id': 'req-41fd218d-d38e-4329-8e25-33fc4e6aa833'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:13.797695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] The token cache is being invalidate because project ab5e0bfbafd04b9fbfce6e8f058fe605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:13.799011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:13.801862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41fd218d-d38e-4329-8e25-33fc4e6aa833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:13.804040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 857/1717] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:13 2022] DELETE /identity/v3/projects/ab5e0bfbafd04b9fbfce6e8f058fe605 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:13.805562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804a4b-939d-46ff-9fba-a1a38826de78 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:13.806455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804a4b-939d-46ff-9fba-a1a38826de78 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:13.807451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7804a4b-939d-46ff-9fba-a1a38826de78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:13.885041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f7804a4b-939d-46ff-9fba-a1a38826de78 None None] MFA Rules not processed for user `480b3062a1684914896e63a8f7f64881`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:13.889774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f7804a4b-939d-46ff-9fba-a1a38826de78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.003466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 861/1718] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:14.005239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:14.010977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.086662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 858/1719] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:14.088042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.088341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.092397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:14.160320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] MFA Rules not processed for user `d6cc94b4e59c4b3ba507cc2e696e1a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:14.161824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.223995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61fac9-2d94-4dbe-857c-cb7b2158d99f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:14.236909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:14.237735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.237993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.238737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:14.249399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.348790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 859/1720] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:14.349700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:14.352761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.409457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:14.411537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:14.461903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 862/1721] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:14.463683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:14.472321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.643574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec001e-6ba8-4caa-8d89-1602cca5402a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:14.661624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:14.663232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.663719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.664177 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] PATH_INFO: `/v3/projects/646aa206765f430eb5fab7af1c610700/users/0781c7e83c3346c8a3f5f9cb43518f0b/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:14.706070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646aa206765f430eb5fab7af1c610700, user_id=0781c7e83c3346c8a3f5f9cb43518f0b, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:14.716428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1d1ed-fdf5-431d-822d-3d8c75e4f1a9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:14.733748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215625f-fb7f-48ce-82c3-9b1ac4dce03b service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:14.745084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 860/1722] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:14 2022] PUT /identity/v3/projects/646aa206765f430eb5fab7af1c610700/users/0781c7e83c3346c8a3f5f9cb43518f0b/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:14.747271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fcfb3-0761-433b-90ad-f02a7f3e8ec1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.752580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fcfb3-0761-433b-90ad-f02a7f3e8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.754175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fcfb3-0761-433b-90ad-f02a7f3e8ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:14.804741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f27fcfb3-0761-433b-90ad-f02a7f3e8ec1 None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:14.806488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f27fcfb3-0761-433b-90ad-f02a7f3e8ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:14.903189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:14.905380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.906507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.912445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] PATH_INFO: `/v3/users/99cfea9748844a3596e7e6d4521f577d` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:14.914813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cfea9748844a3596e7e6d4521f577d)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:14.920771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:14.960870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 861/1723] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Apr 1 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:14.964736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:14.965173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:14.967163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:15.027249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] MFA Rules not processed for user `3ca94cdcf3824f56a886b757e41602dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:15.029240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.036575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cfea9748844a3596e7e6d4521f577d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:15.038210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cfea9748844a3596e7e6d4521f577d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:15.070750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cfea9748844a3596e7e6d4521f577d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:15.103409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cfea9748844a3596e7e6d4521f577d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:15.123969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cfea9748844a3596e7e6d4521f577d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:15.141111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 863/1724] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:14 2022] DELETE /identity/v3/users/99cfea9748844a3596e7e6d4521f577d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:15.151820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:15.159443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.225205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 862/1725] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:15.226227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:15.227882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.373005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408a957-520e-4c2f-bffa-94543eec5fb7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:15.401603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:15.402317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:15.402600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:15.403125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:15.403869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:15.410068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098c54f-2e07-439b-ae5d-f8861f911fd9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:15.428593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42706d3-3b89-4172-b6aa-f91fa27e54ad None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:15.481203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 864/1726] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:15 2022] POST /identity/v3/projects => generated 371 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:15.485840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:15.486145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:15.486427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:15.552769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] MFA Rules not processed for user `0781c7e83c3346c8a3f5f9cb43518f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:15.553863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.594846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:15.595666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:15.596045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:15.596415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:15.605238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.693839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 865/1727] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:15.695050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:15.696846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.816517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:15.822715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:15.876704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 863/1728] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:15.879767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:15.881026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0552c-8035-486c-89c7-49cedb5f555f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:15.883036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:15.893756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:15.894544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:15.895012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:15.895331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:15.901888 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.044848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170849-0200-44b3-b417-fbc5b732cfbb service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:16.087766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.090919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:16.173796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 866/1729] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:16.175155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:16.182380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.314186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:16.314593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:16.314918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:16.315213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:16.330257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.365180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.367449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:16.376742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedc6b7-2393-4b01-ae02-b8fed4d5e68b service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:16.384629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:16.386994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:16.387628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:16.388060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:16.390695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.406444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 864/1730] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:16.407799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:16.640978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.642615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:16.684450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e7a95-0c58-4f4e-b263-82dcfbf1b8cf service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:16.693336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 867/1731] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:16.706626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:16.716661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.735335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:16.736304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:16.736596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:16.736874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:16.737590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.739697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:16.772056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ae103-4da1-4393-a0b2-c590dbec1d7c service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:16.799989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:16.805926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:16.806225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:16.806517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:16.807404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.809339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:16.824534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 865/1732] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:16 2022] POST /identity/v3/users => generated 292 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:16.836657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:16.848136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:16.913346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2140c7-55fd-4946-9a31-884e23914fc2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:16.929795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 868/1733] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:16 2022] POST /identity/v3/projects => generated 393 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:16.933291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:16.956101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:16.958125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:16.962301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:16.963509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] PATH_INFO: `/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:16.972295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce851b3fae34a3e965e2f33a9d39d6d)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:16.979627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.102312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e1aab-635c-4bce-a932-02cc8b0bee93 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.123065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:17.124124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.124562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.124991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.126269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:17.132701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.155018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 869/1734] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:17.160766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:17.171094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce851b3fae34a3e965e2f33a9d39d6d', 'request_id': 'req-f5c60896-0d79-4d46-a018-604f21cde87e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:17.184970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d105b9-108e-47ea-9d1a-f482218abf7d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.209612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce851b3fae34a3e965e2f33a9d39d6d', 'request_id': 'req-f5c60896-0d79-4d46-a018-604f21cde87e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:17.237324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce851b3fae34a3e965e2f33a9d39d6d', 'request_id': 'req-f5c60896-0d79-4d46-a018-604f21cde87e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:17.276905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] The token cache is being invalidate because project cce851b3fae34a3e965e2f33a9d39d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:17.277202 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:17.278019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:17.281600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 866/1735] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:16 2022] DELETE /identity/v3/projects/cce851b3fae34a3e965e2f33a9d39d6d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:17.296159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:17.298511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:17.379429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:17.380379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.381572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.381859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.382586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:17.384623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9270a5-85ab-4b80-bd74-4e2ef8ab06fd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.445683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 870/1736] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:17 2022] POST /identity/v3/users => generated 303 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:17.450435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.452262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.452693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.483544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c60896-0d79-4d46-a018-604f21cde87e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.500630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:17.502408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.505101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.505484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] PATH_INFO: `/v3/projects/68bc299b8dc1471294842864af9fe985/users/35e0633abb844a79a9db60704eb93979/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.529415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:17.530360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bc299b8dc1471294842864af9fe985, user_id=35e0633abb844a79a9db60704eb93979, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:17.532936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:17.535379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8491b3d-6aed-480d-a907-d012c7cecea0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.564577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 871/1737] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:17.566410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:17.573198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:17.582685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 867/1738] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:17 2022] PUT /identity/v3/projects/68bc299b8dc1471294842864af9fe985/users/35e0633abb844a79a9db60704eb93979/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:17.588031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.589717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.590193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.616435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece956ce-8334-4fd3-a0df-f36b37fa3766 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.641407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:17.644944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:17.815419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 868/1739] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:17.817648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:17.836018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977993f1-191d-49e4-8e99-7aaa655b919a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.855527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:17.858942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.859241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.861257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.864938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:17.876395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2c5e1-c369-41bc-ac91-a0c8eb3dddff admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.903872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:17.911804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.912919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.913370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.915659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:17.917447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:17.929509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 869/1740] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:17.932550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:17.936881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:17.939610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:17.968240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 872/1741] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:17.972289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:17.990888 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c19f46-aeb1-4aa2-958f-4a4acfe2aa89 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:17.993875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] MFA Rules not processed for user `a0661916b4064097a834dcef7e02b3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:17.995777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:18.026790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.030205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.031988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.032433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.034881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:18.036821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.043365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:18.077934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 873/1742] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:18.078250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:18.126318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a1e88-a762-4d6d-b45a-118268e1cda1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:18.147365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.152783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.155360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.156486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] PATH_INFO: `/v3/projects/68bc299b8dc1471294842864af9fe985/users/35e0633abb844a79a9db60704eb93979/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.164434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bc299b8dc1471294842864af9fe985, user_id=35e0633abb844a79a9db60704eb93979, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.172747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:18.220197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 874/1743] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:18 2022] PUT /identity/v3/projects/68bc299b8dc1471294842864af9fe985/users/35e0633abb844a79a9db60704eb93979/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:18.222006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:18.301469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 870/1744] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:18.305458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:18.363715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3cba-a042-47ab-a34a-d74b9fb312fe admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:18.373955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.376460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.376941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.377680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] PATH_INFO: `/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a/users/7a5004b7cee54cfab62352219bc1cfcf/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.384209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82585e-6a02-4d34-90f2-59b858ec550f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:18.394451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.395212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.395742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.396029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.404365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.406590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:18.409683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e7e97a7fb34cd887cf5c785fa2842a, user_id=7a5004b7cee54cfab62352219bc1cfcf, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.420670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da04a9-17e4-44bc-bfba-0e14ae324079 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:18.472693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 875/1745] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:18 2022] PUT /identity/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a/users/7a5004b7cee54cfab62352219bc1cfcf/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:18.480794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.481224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.481616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.492024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 871/1746] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:18 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:18.493091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:18.501703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:18.617934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] MFA Rules not processed for user `35e0633abb844a79a9db60704eb93979`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:18.633664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:18.689091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba539a-3a54-446a-a5b0-19d2cccf1e32 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:18.707163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.707999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.708270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.708516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.836301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.837952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a1d96-8d66-40ea-a52a-2599bbda1da8 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:18.849141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 872/1747] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:18.850845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3f43-4e8f-4766-a812-68ac9842ddd7 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.851142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3f43-4e8f-4766-a812-68ac9842ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.851488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac3f43-4e8f-4766-a812-68ac9842ddd7 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.854015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 873/1748] 10.222.0.46 () {54 vars in 912 bytes} [Fri Apr 1 10:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:18.854846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3f43-4e8f-4766-a812-68ac9842ddd7 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:18.960923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac3f43-4e8f-4766-a812-68ac9842ddd7 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:18.983087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:18.983874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:18.984221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:18.984684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:18.985128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 876/1749] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:18.985590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:18.990581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e538-dcc4-4358-9a62-ac071f3f1da0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:19.001033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:19.011016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 874/1750] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:19.013354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.013685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.013991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.072377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa9fa2-b295-45b3-ad66-1806094045cb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:19.078913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:19.081450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:19.106145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:19.108599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.113145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.113419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.119082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:19.128948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:19.231291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 877/1751] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:18 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:19.238222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:19.251942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:19.292533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 875/1752] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:19.293560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:19.328386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c9b4-b44a-4c32-97d0-7b0d4b11b7f4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:19.347920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:19.348849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.349139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.349420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] PATH_INFO: `/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a/users/7a5004b7cee54cfab62352219bc1cfcf/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.358386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e7e97a7fb34cd887cf5c785fa2842a, user_id=7a5004b7cee54cfab62352219bc1cfcf, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:19.361383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:19.420996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 876/1753] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:19 2022] PUT /identity/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a/users/7a5004b7cee54cfab62352219bc1cfcf/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:19.427109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:19.507622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3d90-21aa-41d7-b0e5-e9e957e197d7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:19.642729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897412a-e755-4f46-9a1d-e89a09c9aeb3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:19.647363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:19.652214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.652498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.652778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.667463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:19.668258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.668592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.668906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.670106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:19.676448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:19.720709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 877/1754] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:19.721818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:19.729699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:19.843011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:19.844540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a409c-0e06-419a-af5d-009b502d125f service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:19.899765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 878/1755] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:19.906330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.906701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.907000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.966098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1878fa-c388-4450-af8f-a94688000192 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:19.975893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:19.976762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:19.977308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:19.977595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:19.999869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:20.004840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:20.007089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] MFA Rules not processed for user `7a5004b7cee54cfab62352219bc1cfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:20.008358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:20.027198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 878/1756] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:20.028056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:20.054676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1844e-7877-4ec7-836f-befda46cbb80 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:20.084157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:20.084869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.085154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.085428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.086164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:20.087817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f0f2c-2989-49b3-8ecd-0fbbd946c56b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:20.157900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 879/1757] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:20.157900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8b19-7153-41de-a84a-c3a01b64ef48 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.157900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8b19-7153-41de-a84a-c3a01b64ef48 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.157900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8b19-7153-41de-a84a-c3a01b64ef48 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.173947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 880/1758] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:04:20 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:20.184482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae8b19-7153-41de-a84a-c3a01b64ef48 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:20.225728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae8b19-7153-41de-a84a-c3a01b64ef48 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:20.255707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:20.256766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.257055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.257832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] PATH_INFO: `/v3/projects/bfe20ebb9d4f4f5796317f7e9579cd59/users/6832022ee2be4fe9bae66bee13c791f7/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.303727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe20ebb9d4f4f5796317f7e9579cd59, user_id=6832022ee2be4fe9bae66bee13c791f7, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:20.311644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97737f1-1f31-485c-a4d6-baa9053a31bf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:20.346406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 879/1759] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:20.353508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 881/1760] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:20 2022] PUT /identity/v3/projects/bfe20ebb9d4f4f5796317f7e9579cd59/users/6832022ee2be4fe9bae66bee13c791f7/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:20.366683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:20.367128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919167c-7722-40cf-a360-77bf90670f49 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.367440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919167c-7722-40cf-a360-77bf90670f49 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.367719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919167c-7722-40cf-a360-77bf90670f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.402954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe386505-4e70-4f17-bb4a-3a6822792d65 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:20.422349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0919167c-7722-40cf-a360-77bf90670f49 None None] MFA Rules not processed for user `6832022ee2be4fe9bae66bee13c791f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:20.423931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0919167c-7722-40cf-a360-77bf90670f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:20.540574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:20.541738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.542234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.542752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.612332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 882/1761] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:20.612332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.612332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.612332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.663057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:20.664354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:20.724291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:20.726322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:20.769330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 880/1762] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:20.770619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:20.831276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 883/1763] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:20.940415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:20.952724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc70a8-51ee-41ba-ba45-b587a8bcb778 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:20.969023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:20.969702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:20.969982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:20.970264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:20.994061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:20.998142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.003803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043dc18-ea18-408c-917d-046e2cca0f8e service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.020474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.022011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.022569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.023131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.024386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.027006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.037168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 884/1764] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:21.038188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.055665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4e95d-3362-473d-a944-4ba146a51e9c service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.061959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.062759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.063052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.063333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.066387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:21.101229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 881/1765] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:20 2022] POST /identity/v3/projects => generated 383 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:21.102511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.316505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae46d8-4058-4ddf-9684-556ae53d0d13 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.343713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.345278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.356690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.356690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.356690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.358693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.361360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.361681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.384285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 885/1766] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:21.425489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 882/1767] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:21 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:21.426810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.443172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2869-8c61-4511-adb4-0460cbfc9a7e service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.482866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.483607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.483898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.484170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.484913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.486580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.549284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 886/1768] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:21.550890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.571985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2857f0b-7c30-4d23-b2f4-6c98e49caca9 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.593317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.595467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.600033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.600417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] PATH_INFO: `/v3/projects/166819a869b54effaea9bbb42e218770/users/64f948a6114c479fa0caa2abffbd2331/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.661768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166819a869b54effaea9bbb42e218770, user_id=64f948a6114c479fa0caa2abffbd2331, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.664535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.706190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 883/1769] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:21 2022] PUT /identity/v3/projects/166819a869b54effaea9bbb42e218770/users/64f948a6114c479fa0caa2abffbd2331/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:21.710627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.724836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab643207-b9f2-41ba-88e4-b56e0bd156a7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:21.896014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:21.896927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:21.897371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:21.897790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:21.899133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:21.903404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:21.960692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.963143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 887/1770] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:21.974443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:21.977145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0130711-5663-43a6-bb78-26241a44e716 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:22.005998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:22.011495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.014386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.015640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] PATH_INFO: `/v3/users/480b3062a1684914896e63a8f7f64881` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.019163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480b3062a1684914896e63a8f7f64881)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:22.021790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e268b7-b065-4b86-9d8e-ba190a30bc0c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:22.026895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:22.036735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:22.039286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.041376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.041727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] PATH_INFO: `/v3/projects/166819a869b54effaea9bbb42e218770/users/64f948a6114c479fa0caa2abffbd2331/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.047867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166819a869b54effaea9bbb42e218770, user_id=64f948a6114c479fa0caa2abffbd2331, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:22.056893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb42a10-ba8d-428f-a9f9-2d266e377e88 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:22.106589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 888/1771] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:21 2022] PUT /identity/v3/projects/166819a869b54effaea9bbb42e218770/users/64f948a6114c479fa0caa2abffbd2331/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:22.121978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.122784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.123698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.187243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480b3062a1684914896e63a8f7f64881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:22.187948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480b3062a1684914896e63a8f7f64881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:22.201650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480b3062a1684914896e63a8f7f64881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:22.225199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] MFA Rules not processed for user `64f948a6114c479fa0caa2abffbd2331`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:22.226942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:22.253550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480b3062a1684914896e63a8f7f64881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:22.277106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-703b8291-d66d-4e72-b565-bc2472d22c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480b3062a1684914896e63a8f7f64881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:22.298172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 884/1772] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:21 2022] DELETE /identity/v3/users/480b3062a1684914896e63a8f7f64881 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:22.303905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.304175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.304456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.427170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:22.428513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:22.446491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 889/1773] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:22.470002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:22.472623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:22.686257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754ecd5-8497-4902-b11b-67c4ac1f02a4 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:22.728418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 885/1774] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:22.756810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:22.759132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:22.871886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:22.873165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.873405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.873781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.929442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a56b9-3a28-4cef-a807-583439fd4836 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:22.943395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:22.943635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:22.943898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:22.944176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:22.971128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:22.972934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3c7cf-20e2-4b43-9598-1250ce8158fb service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:22.995763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:22.997055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 886/1775] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:23.001627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:23.043976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 890/1776] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:23.057543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e2f0-c99b-4993-8510-a7bab4fa3ab7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:23.058040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e2f0-c99b-4993-8510-a7bab4fa3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:23.058198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e2f0-c99b-4993-8510-a7bab4fa3ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:23.092747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-48d7e2f0-c99b-4993-8510-a7bab4fa3ab7 None None] MFA Rules not processed for user `d6cc94b4e59c4b3ba507cc2e696e1a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:23.094017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-48d7e2f0-c99b-4993-8510-a7bab4fa3ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:23.172227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:23.187479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971c28c-1792-497a-9d38-c942e950e78b service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:23.201014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:23.203418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:23.204871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:23.210238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:23.221302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:23.224818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 887/1777] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:23.363393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:23.365174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:23.407300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 891/1778] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:23.696292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af418-c72d-4a25-802c-e99b399ec827 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:23.696855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af418-c72d-4a25-802c-e99b399ec827 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:23.697304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03af418-c72d-4a25-802c-e99b399ec827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:23.751864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f03af418-c72d-4a25-802c-e99b399ec827 None None] MFA Rules not processed for user `3ca94cdcf3824f56a886b757e41602dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:23.758323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f03af418-c72d-4a25-802c-e99b399ec827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:23.887627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 888/1779] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:23.936864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:23.939167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:23.975587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da646c8c-e804-4aa5-a8c8-90ef36eabfeb service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:23.992834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:23.999867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:24.000541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:24.000541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] PATH_INFO: `/v3/users/6832022ee2be4fe9bae66bee13c791f7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:24.001957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6832022ee2be4fe9bae66bee13c791f7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:24.006682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:24.080545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6832022ee2be4fe9bae66bee13c791f7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:24.096080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6832022ee2be4fe9bae66bee13c791f7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:24.136568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6832022ee2be4fe9bae66bee13c791f7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:24.137690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6832022ee2be4fe9bae66bee13c791f7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:24.139269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6832022ee2be4fe9bae66bee13c791f7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:24.164247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 892/1780] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:23 2022] DELETE /identity/v3/users/6832022ee2be4fe9bae66bee13c791f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:24.166165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:24.166925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:24.166925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:24.201164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:24.203953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:24.464733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 889/1781] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:24.515392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:24.516987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:24.658519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c585110-cf94-4dbe-84c8-bb9b6cc7c84f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:24.663982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:24.665426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:24.666104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:24.666640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:24.694140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:24.697024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:24.721620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 893/1782] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:25.226033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:25.227724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:25.242803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f13b-edbd-48a7-8962-e63ce4b3a411 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:25.257480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:25.258992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:25.259468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:25.260116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] PATH_INFO: `/v3/projects/a0fcfba8ae0b4ec78d3cafc06673ec5a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:25.262133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0fcfba8ae0b4ec78d3cafc06673ec5a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:25.265335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:25.427191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0fcfba8ae0b4ec78d3cafc06673ec5a', 'request_id': 'req-e3088199-e9f4-4774-982e-62734816c02c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.439013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0fcfba8ae0b4ec78d3cafc06673ec5a', 'request_id': 'req-e3088199-e9f4-4774-982e-62734816c02c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.473883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0fcfba8ae0b4ec78d3cafc06673ec5a', 'request_id': 'req-e3088199-e9f4-4774-982e-62734816c02c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.535208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] The token cache is being invalidate because project a0fcfba8ae0b4ec78d3cafc06673ec5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:25.538382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.541913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e3088199-e9f4-4774-982e-62734816c02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.550681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 890/1783] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:25 2022] DELETE /identity/v3/projects/a0fcfba8ae0b4ec78d3cafc06673ec5a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:25.554935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:25.582489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4e75d-0990-43c5-aa34-ffe994d1e170 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:25.764700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:25.765607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:25.765890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:25.766220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] PATH_INFO: `/v3/users/35e0633abb844a79a9db60704eb93979` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:25.768024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e0633abb844a79a9db60704eb93979)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:25.772216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:25.973166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e0633abb844a79a9db60704eb93979'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:25.991083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e0633abb844a79a9db60704eb93979'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.012548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e0633abb844a79a9db60704eb93979'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.013294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e0633abb844a79a9db60704eb93979'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.013941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e0633abb844a79a9db60704eb93979'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.034887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f30f6-dd41-478f-811c-48da354417af None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:26.035392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f30f6-dd41-478f-811c-48da354417af None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:26.042237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 894/1784] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:25 2022] DELETE /identity/v3/users/35e0633abb844a79a9db60704eb93979 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:26.043395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f30f6-dd41-478f-811c-48da354417af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:26.083424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c85f30f6-dd41-478f-811c-48da354417af None None] MFA Rules not processed for user `a0661916b4064097a834dcef7e02b3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:26.088563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c85f30f6-dd41-478f-811c-48da354417af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:26.122125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:26.123904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:26.223485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 891/1785] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:26.336180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca32b-827e-4878-917b-ba74d97ac43e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:26.362929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:26.363854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:26.364142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:26.364421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] PATH_INFO: `/v3/projects/bfe20ebb9d4f4f5796317f7e9579cd59` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:26.372388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe20ebb9d4f4f5796317f7e9579cd59)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:26.374388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:26.525254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe20ebb9d4f4f5796317f7e9579cd59', 'request_id': 'req-e7081bab-3127-4321-9565-90b308b022d9'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.545171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe20ebb9d4f4f5796317f7e9579cd59', 'request_id': 'req-e7081bab-3127-4321-9565-90b308b022d9'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.556004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe20ebb9d4f4f5796317f7e9579cd59', 'request_id': 'req-e7081bab-3127-4321-9565-90b308b022d9'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.585599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] The token cache is being invalidate because project bfe20ebb9d4f4f5796317f7e9579cd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:26.586498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.587556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.594265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f30f6-dd41-478f-811c-48da354417af None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:26.594823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 895/1786] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:26 2022] DELETE /identity/v3/projects/bfe20ebb9d4f4f5796317f7e9579cd59 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:26.612716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f30f6-dd41-478f-811c-48da354417af None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:26.781911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:26.783606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:26.787428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:26.788003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] PATH_INFO: `/v3/users/64f948a6114c479fa0caa2abffbd2331` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:26.792160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f948a6114c479fa0caa2abffbd2331)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:26.799761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:26.915332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f948a6114c479fa0caa2abffbd2331'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.916332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f948a6114c479fa0caa2abffbd2331'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.929565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f948a6114c479fa0caa2abffbd2331'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.956248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f948a6114c479fa0caa2abffbd2331'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.978499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b17bc87-1a0f-448e-a5ea-9f08725144ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f948a6114c479fa0caa2abffbd2331'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:26.996945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 892/1787] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:26 2022] DELETE /identity/v3/users/64f948a6114c479fa0caa2abffbd2331 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:27.274027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:27.275595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:27.298459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081bab-3127-4321-9565-90b308b022d9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:27.423414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:27.426085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:27.427032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:27.427389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] PATH_INFO: `/v3/projects/68bc299b8dc1471294842864af9fe985` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:27.430377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bc299b8dc1471294842864af9fe985)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:27.448465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:27.620365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bc299b8dc1471294842864af9fe985', 'request_id': 'req-76cfb7c7-73e5-45bc-b942-d07b37972f7c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.632913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bc299b8dc1471294842864af9fe985', 'request_id': 'req-76cfb7c7-73e5-45bc-b942-d07b37972f7c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.640114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bc299b8dc1471294842864af9fe985', 'request_id': 'req-76cfb7c7-73e5-45bc-b942-d07b37972f7c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.656001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] The token cache is being invalidate because project 68bc299b8dc1471294842864af9fe985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:27.656001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.657053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.658729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 896/1788] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:27 2022] DELETE /identity/v3/projects/68bc299b8dc1471294842864af9fe985 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:27.664034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0673-44fd-4cc2-b690-3f17708ace86 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:27.664537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0673-44fd-4cc2-b690-3f17708ace86 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:27.664649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a0673-44fd-4cc2-b690-3f17708ace86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:27.685794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a17a0673-44fd-4cc2-b690-3f17708ace86 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:27.687008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a17a0673-44fd-4cc2-b690-3f17708ace86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:27.692163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:27.696032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:27.771988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 893/1789] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:27.781700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:27.782825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:27.783766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:27.808726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb7c7-73e5-45bc-b942-d07b37972f7c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:27.814990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:27.816250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:27.816526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:27.816807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] PATH_INFO: `/v3/projects/166819a869b54effaea9bbb42e218770` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:27.818362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=166819a869b54effaea9bbb42e218770)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:27.820335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:27.839856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:27.845431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:27.864138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 894/1790] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:27.868460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:27.890597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b206-aac8-4687-b1a6-7e03dc90aa72 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:27.891706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166819a869b54effaea9bbb42e218770', 'request_id': 'req-faa63200-4d63-41ef-83a5-a955add591c5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.903814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166819a869b54effaea9bbb42e218770', 'request_id': 'req-faa63200-4d63-41ef-83a5-a955add591c5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.913523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166819a869b54effaea9bbb42e218770', 'request_id': 'req-faa63200-4d63-41ef-83a5-a955add591c5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.936299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] The token cache is being invalidate because project 166819a869b54effaea9bbb42e218770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:27.936591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.937717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-faa63200-4d63-41ef-83a5-a955add591c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:27.942362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 897/1791] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:27 2022] DELETE /identity/v3/projects/166819a869b54effaea9bbb42e218770 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:27.947232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b6e-b7f7-4d8b-94d3-1a6df7040670 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:27.947600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b6e-b7f7-4d8b-94d3-1a6df7040670 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:27.947930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53b6e-b7f7-4d8b-94d3-1a6df7040670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:27.994356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-cdf53b6e-b7f7-4d8b-94d3-1a6df7040670 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:27.995681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-cdf53b6e-b7f7-4d8b-94d3-1a6df7040670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:28.000661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.001867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.012643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.013267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.014323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:28.014854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.017026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.019710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 898/1792] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:28.021296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.021633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.021919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.035976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 895/1793] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:28.040171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.042006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:28.054348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:28.055909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:28.057358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e65ce-239f-4550-9ae7-1c9e6a0e24b5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.064809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.065594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.065946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.066314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.066715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 899/1794] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:28.067051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.068965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.070712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.080362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e759624-764a-4c71-bf7e-c25720574cd8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.085665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.086435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.087045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.093912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.093912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:28.093912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.093912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.111787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 900/1795] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:04:28.116272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.146236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 896/1796] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:28.147269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.148123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f0be7-60ea-42a6-bce3-dd3b74f055c8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.254911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20a81a-df48-46ff-8ce0-edfa87af90a3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.256653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.257345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.258771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.259700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.261531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.262424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.269611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.270369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.270683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.270958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.271675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.273998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.326063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 897/1797] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/users => generated 279 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:28.326701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 901/1798] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:28.331248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.332616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.352176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc8a01-13a3-45c0-a314-d45cc16e0689 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.450920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.451580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.452078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.452585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.453233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.456062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.474293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 898/1799] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:28.475733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.480367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea1d32-2ead-4754-8a62-a136aa860250 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.485703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.486432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566273-0a6e-4d08-8804-d446d48db2a5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.488029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.488548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.489034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.489976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.495164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.496732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.497457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.497739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.498016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.498878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.500568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.521321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 902/1800] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:28.522113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 899/1801] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:28.522337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.525395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.532964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ed62-d155-4199-884b-4913484784e2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.536414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297a401-0253-4279-b1c4-76f975108625 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.541758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.542997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.543573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.543880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.544738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.546555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.561728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.564712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.565207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.565683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] PATH_INFO: `/v3/projects/db6891de1e6f4196997f56e4993967d4/users/e3471bda9ad3407a85135ac6bca211a9/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.570715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 900/1802] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:28.575097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.590101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6891de1e6f4196997f56e4993967d4, user_id=e3471bda9ad3407a85135ac6bca211a9, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.592971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4f3cf-7326-4724-8156-501cb2520fd5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.594860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfa3a7-0628-4c2e-8124-d5e6edff6383 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.600677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.601479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.601883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.602258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.603134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.605079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.608815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 903/1803] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:28 2022] PUT /identity/v3/projects/db6891de1e6f4196997f56e4993967d4/users/e3471bda9ad3407a85135ac6bca211a9/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:28.619756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.620258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.620721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.627811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 901/1804] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:28.629925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.646211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2861b7c-3a3b-4eab-991e-69a557972218 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.656670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] MFA Rules not processed for user `e3471bda9ad3407a85135ac6bca211a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:28.657961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:28.714001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.715074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.715465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.715815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] PATH_INFO: `/v3/projects/cc83e5db0ea54fb7837691f4fac4ca85/users/d843f96920a94f5fb1e2ab41f5b0f09a/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.734220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc83e5db0ea54fb7837691f4fac4ca85, user_id=d843f96920a94f5fb1e2ab41f5b0f09a, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.737051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318545ff-7294-4375-8273-cebb51849ca0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.745486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 904/1805] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:28.750243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.751766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 902/1806] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:28 2022] PUT /identity/v3/projects/cc83e5db0ea54fb7837691f4fac4ca85/users/d843f96920a94f5fb1e2ab41f5b0f09a/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:28.762895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.763189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.763475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.774164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c39c1b-5896-468d-96bf-9bae55ded0db None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.806891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] MFA Rules not processed for user `d843f96920a94f5fb1e2ab41f5b0f09a`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:28.808449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:28.849586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.850765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.852047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.852510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.853408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.855823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.888545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 905/1807] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/projects => generated 355 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:28.890913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 903/1808] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:28.892426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.892588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:28.903211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856dc50-ec6b-4506-8a26-935e68277578 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.964477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7fa14-d768-41c8-a8cc-043faa616ef3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:28.971353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.972143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.972527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.972960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.973796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.975242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:28.975994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:28.976115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:28.976292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:28.976595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:28.977337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:28.980009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.007221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 904/1809] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:29.010351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 906/1810] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:28 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:29.011437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.015781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.024545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f052-6de2-412b-87b2-5d3fec64f176 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.135493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da8b9-a94f-413d-8f04-4fa2527b5e3b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.141345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.142275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.142705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.143070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.144223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.146479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.154229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.159245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.159715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.161997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.163429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.168502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.194407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 907/1811] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:29 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:29.195607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.203234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 905/1812] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:29.207907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.211111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e39403-2c52-4be8-b993-c9d3947abdd8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.216620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.218810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.219180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.219542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.220377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.222285 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.238305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 908/1813] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:29.241168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67510de-dc84-4b68-bd77-018235557f6d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.242188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.255769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3a748-5094-4ef9-b4d0-0f32724beee9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.276683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.277772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.278155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.278535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] PATH_INFO: `/v3/projects/899f3cd6b3534765a9002af8e1917b3f/users/1a3e133e332845fab9a97b0930345c79/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.283827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.286029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.286310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.286583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] PATH_INFO: `/v3/projects/0ee9529ccf8943cb9bf57be8859b781a/users/cf921f6ba29a4ff9bcb5f40f213321e8/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.313354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee9529ccf8943cb9bf57be8859b781a, user_id=cf921f6ba29a4ff9bcb5f40f213321e8, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.315442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=899f3cd6b3534765a9002af8e1917b3f, user_id=1a3e133e332845fab9a97b0930345c79, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.318922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.322833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.339573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 906/1814] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:29 2022] PUT /identity/v3/projects/0ee9529ccf8943cb9bf57be8859b781a/users/cf921f6ba29a4ff9bcb5f40f213321e8/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:29.343218 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 909/1815] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:29 2022] PUT /identity/v3/projects/899f3cd6b3534765a9002af8e1917b3f/users/1a3e133e332845fab9a97b0930345c79/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:29.343578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.346961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.417576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2ab6c-60f3-4604-9063-8d30f9ed7aa6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.423142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.423290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d20aba-883a-4ecf-8505-82e73efd0e5f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.423826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.424148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.424556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.425467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.427795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.429444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.430276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.430733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.431081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.431951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.433710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.443205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 907/1816] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:29.444801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 910/1817] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:29.448962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.449585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.464136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07f1f-6944-4962-b664-8dee24d474be admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.471042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.472065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.472350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.472623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] PATH_INFO: `/v3/projects/899f3cd6b3534765a9002af8e1917b3f/users/1a3e133e332845fab9a97b0930345c79/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.474769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899f3cd6b3534765a9002af8e1917b3f, user_id=1a3e133e332845fab9a97b0930345c79, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.476116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f186bc-620d-4287-9e09-3ed9b00ddbad admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.477522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57793c3-4ab5-42c3-9547-c2ef178f3bc5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.488047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.489058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.489330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.489607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] PATH_INFO: `/v3/projects/0ee9529ccf8943cb9bf57be8859b781a/users/cf921f6ba29a4ff9bcb5f40f213321e8/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.491757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee9529ccf8943cb9bf57be8859b781a, user_id=cf921f6ba29a4ff9bcb5f40f213321e8, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.494723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e50d1c-af84-450c-82d9-80b68efc60c8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.509149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 908/1818] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:29 2022] PUT /identity/v3/projects/899f3cd6b3534765a9002af8e1917b3f/users/1a3e133e332845fab9a97b0930345c79/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:29.509354 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 911/1819] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:29 2022] PUT /identity/v3/projects/0ee9529ccf8943cb9bf57be8859b781a/users/cf921f6ba29a4ff9bcb5f40f213321e8/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:29.509463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.509463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.509624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.518750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.519048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.519331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.542438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] MFA Rules not processed for user `1a3e133e332845fab9a97b0930345c79`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:29.543857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:29.546087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] MFA Rules not processed for user `cf921f6ba29a4ff9bcb5f40f213321e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:29.547294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:29.609279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 909/1820] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:29.618637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 912/1821] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:29.623771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.625273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:29.678386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6207db8-1d16-4a17-989f-8b143bbfeaf7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.682279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.682929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.683267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.683493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.734533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.736029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:29.737798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.739425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.748211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1f96-acf3-43fd-a06c-2ecead424018 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.749193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 910/1822] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:29.752339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.752987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.753348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.753623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:29.763942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:29.765447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:29.775652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 913/1823] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:29.927128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:29.933003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57ea7d-8902-4d3c-96b1-6f1f8341a6b3 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:29.936894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:29.937557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:29.937859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:29.938135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:30.002021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:30.003518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ba836-8925-40e3-b6d9-134dc38ab77c service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:30.023919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 911/1824] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:32.210553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:32.212763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:32.320626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaceebc-ad92-4f29-8d87-73b6aa8b625b service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:32.327506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:32.329090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:32.329357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:32.329626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] PATH_INFO: `/v3/users/0781c7e83c3346c8a3f5f9cb43518f0b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:32.331003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0781c7e83c3346c8a3f5f9cb43518f0b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:32.333029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:32.418976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0781c7e83c3346c8a3f5f9cb43518f0b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:32.436827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0781c7e83c3346c8a3f5f9cb43518f0b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:32.494446 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0781c7e83c3346c8a3f5f9cb43518f0b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:32.496459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0781c7e83c3346c8a3f5f9cb43518f0b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:32.497487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0781c7e83c3346c8a3f5f9cb43518f0b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:32.524500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:32.526568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:32.528056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:32.538587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 914/1825] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:32 2022] DELETE /identity/v3/users/0781c7e83c3346c8a3f5f9cb43518f0b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:32.564663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:32.566528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:32.658612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 912/1826] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:32.712352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:32.714043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:32.777356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53185bb-bff2-4b7d-8f6d-3c0edc3ff496 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:32.781087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:32.781743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:32.782025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:32.782297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:32.791450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:32.792896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:32.802387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 915/1827] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:33.962264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:33.967863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:33.982675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d53dec-6896-438e-b5ce-63ccd8052a5e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:34.018996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:34.022154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:34.024693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:34.024693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] PATH_INFO: `/v3/projects/646aa206765f430eb5fab7af1c610700` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:34.028619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=646aa206765f430eb5fab7af1c610700)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:34.033540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:34.196654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646aa206765f430eb5fab7af1c610700', 'request_id': 'req-24eda8ce-d253-46ff-af55-f18afaeae66b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.206459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646aa206765f430eb5fab7af1c610700', 'request_id': 'req-24eda8ce-d253-46ff-af55-f18afaeae66b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.217860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646aa206765f430eb5fab7af1c610700', 'request_id': 'req-24eda8ce-d253-46ff-af55-f18afaeae66b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.270778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] The token cache is being invalidate because project 646aa206765f430eb5fab7af1c610700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:34.271228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.274038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.282057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 913/1828] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:33 2022] DELETE /identity/v3/projects/646aa206765f430eb5fab7af1c610700 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:34.283163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:34.293789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b86be9-4f05-4ec7-8cf9-8021f85f3ae9 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:34.421826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:34.423036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:34.423538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:34.423955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] PATH_INFO: `/v3/users/7a5004b7cee54cfab62352219bc1cfcf` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:34.425449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5004b7cee54cfab62352219bc1cfcf)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:34.427938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:34.678089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5004b7cee54cfab62352219bc1cfcf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.707206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5004b7cee54cfab62352219bc1cfcf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.735105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5004b7cee54cfab62352219bc1cfcf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.742367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5004b7cee54cfab62352219bc1cfcf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.747107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5004b7cee54cfab62352219bc1cfcf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:34.794871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 916/1829] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:34 2022] DELETE /identity/v3/users/7a5004b7cee54cfab62352219bc1cfcf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:34.909147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:34.910855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:35.057561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eda8ce-d253-46ff-af55-f18afaeae66b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:35.137067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:35.138344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:35.138899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:35.139352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:35.143246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:35.233728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:35.236001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ccae23-54eb-44c7-89dd-7faec55bed68 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:35.263864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 914/1830] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:35.904264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:35.906111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:36.050537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b03ae5-fac7-4741-9df4-f4625abdf4bf admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.056157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.056661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.056953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.057233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] PATH_INFO: `/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.058439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e7e97a7fb34cd887cf5c785fa2842a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.060751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.138810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e7e97a7fb34cd887cf5c785fa2842a', 'request_id': 'req-869e5dbe-aafd-4f7b-8285-981890fd879a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:36.149462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e7e97a7fb34cd887cf5c785fa2842a', 'request_id': 'req-869e5dbe-aafd-4f7b-8285-981890fd879a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:36.161021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e7e97a7fb34cd887cf5c785fa2842a', 'request_id': 'req-869e5dbe-aafd-4f7b-8285-981890fd879a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:36.198456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] The token cache is being invalidate because project 66e7e97a7fb34cd887cf5c785fa2842a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:36.198841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:36.199579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-869e5dbe-aafd-4f7b-8285-981890fd879a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:36.202096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 917/1831] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:35 2022] DELETE /identity/v3/projects/66e7e97a7fb34cd887cf5c785fa2842a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:36.208892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.209394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.209479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.238582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:36.239820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:36.363559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 915/1832] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:36.371448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.371798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.372001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.395973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:36.398608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:36.413291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.420065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 918/1833] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:36.428858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081380e-f7b9-4715-99f8-35364fc2cf5d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.434500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.435355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.435706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.436187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.437029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:36.437355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.439176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.456140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 916/1834] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:36.461037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.471133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e99957-295d-4fde-81a3-e49526e1b64e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.476236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.477013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.477442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.477672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.478375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.480823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.520977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 919/1835] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:36 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:36.525646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.536296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e03b2-0bc1-4999-b8a5-04bcd958c0e8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.637025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.638237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.639444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.640939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.643003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.647754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.694232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 917/1836] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:36 2022] POST /identity/v3/users => generated 300 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:36.698472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.718879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c112bb8-b551-413b-a363-c48319beb9fa admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.727261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.728772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.728772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.728772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.730678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.735568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.792831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 920/1837] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:36.793700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.815173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0d54a-33b3-4730-a4f1-8535cd118ad0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.823088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.828822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.829095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.829794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.831090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.834867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974dc46-b376-41c3-b655-992d3266b3ed admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.874877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:36.875850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 918/1838] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:36.888190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4a72-a6b0-4d2f-82fd-d769396ccb25 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:36.903681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375bca-324b-4000-b248-36507914530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:36.904857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375bca-324b-4000-b248-36507914530c admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.905434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375bca-324b-4000-b248-36507914530c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.905434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1375bca-324b-4000-b248-36507914530c admin admin] PATH_INFO: `/v3/projects/325997ce1da745a4858a6b7f87624dc7/users/e8efc9fd3c4846a88b9d4060efa94df1/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:36.930443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1375bca-324b-4000-b248-36507914530c admin admin] RBAC: Authorizing `identity:create_grant(project_id=325997ce1da745a4858a6b7f87624dc7, user_id=e8efc9fd3c4846a88b9d4060efa94df1, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:36.933362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1375bca-324b-4000-b248-36507914530c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:36.964168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 921/1839] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:36 2022] PUT /identity/v3/projects/325997ce1da745a4858a6b7f87624dc7/users/e8efc9fd3c4846a88b9d4060efa94df1/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:36.980731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85f6e-237f-4407-80a9-fccedc3a1b65 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:36.981342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85f6e-237f-4407-80a9-fccedc3a1b65 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:36.981791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d85f6e-237f-4407-80a9-fccedc3a1b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.056212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-33d85f6e-237f-4407-80a9-fccedc3a1b65 None None] MFA Rules not processed for user `e8efc9fd3c4846a88b9d4060efa94df1`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:37.060469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-33d85f6e-237f-4407-80a9-fccedc3a1b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:37.255873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 919/1840] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:37.260404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375bca-324b-4000-b248-36507914530c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.271840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe25b-a306-4d1b-bdc0-b8a4c863fea7 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.272384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe25b-a306-4d1b-bdc0-b8a4c863fea7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.272799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fe25b-a306-4d1b-bdc0-b8a4c863fea7 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.275832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 920/1841] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:04:37.303001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.303656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.304074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.343584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:37.344897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:37.425957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1375bca-324b-4000-b248-36507914530c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:37.439379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:37.440287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.440826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.441335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.442551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:37.444702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:37.512487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 922/1842] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:37 2022] POST /identity/v3/projects => generated 401 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:37.516357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.520496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 921/1843] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:37.642863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3466b62-f543-4bfb-bd1c-998bc52f62d8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:37.654640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:37.655246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.655613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.656542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.657529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:37.660403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:37.714985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 923/1844] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:37 2022] POST /identity/v3/users => generated 307 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:37.716530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.731957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e047-6441-44e4-a8be-8c6bbb4daffd None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:37.738843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:37.739739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.740623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.741041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.743317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:37.745099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:37.766365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 922/1845] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:37.770305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.788866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c990a-2622-4f02-8bfe-0c2a4f05daa2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:37.807377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:37.808327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:37.808609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:37.808882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] PATH_INFO: `/v3/projects/0d72e280f4574abca0171235d2d0f300/users/90e102dcfede494a84e8a9b1cba17cd7/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:37.863965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d72e280f4574abca0171235d2d0f300, user_id=90e102dcfede494a84e8a9b1cba17cd7, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:37.867405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:37.916631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 924/1846] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:37 2022] PUT /identity/v3/projects/0d72e280f4574abca0171235d2d0f300/users/90e102dcfede494a84e8a9b1cba17cd7/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:37.921431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.944847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93446d9-ffd4-4332-b400-9a99d6100c8d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:37.996056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:37.997985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:38.059247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.060790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.061361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.062148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.064371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.066202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.086418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 923/1847] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:38.090517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:38.104962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefbab1-2843-45b1-a700-cd0e6d88ad56 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:38.113491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.114746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.115268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.115890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] PATH_INFO: `/v3/projects/0d72e280f4574abca0171235d2d0f300/users/90e102dcfede494a84e8a9b1cba17cd7/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.119143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d72e280f4574abca0171235d2d0f300, user_id=90e102dcfede494a84e8a9b1cba17cd7, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.123512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655795d9-56e9-4515-8ee6-f51fdca084f5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.140396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270d2cd-b925-49f1-b90d-7a1c3c382521 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:38.156804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 924/1848] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:38 2022] PUT /identity/v3/projects/0d72e280f4574abca0171235d2d0f300/users/90e102dcfede494a84e8a9b1cba17cd7/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:38.170670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021df87-c4fc-42cd-9f31-c9381f311e28 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.170968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021df87-c4fc-42cd-9f31-c9381f311e28 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.171914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021df87-c4fc-42cd-9f31-c9381f311e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.265326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e021df87-c4fc-42cd-9f31-c9381f311e28 None None] MFA Rules not processed for user `90e102dcfede494a84e8a9b1cba17cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:38.266540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e021df87-c4fc-42cd-9f31-c9381f311e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:38.318038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.318849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.319222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.319572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.337776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.339741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.383901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 925/1849] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:38.418370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 925/1850] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:38.432342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:38.435687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:38.559534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57765f-8d66-4e4a-b481-ca77ad8f01ae None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.560493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57765f-8d66-4e4a-b481-ca77ad8f01ae None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.561431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57765f-8d66-4e4a-b481-ca77ad8f01ae None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.564117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 926/1851] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:04:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 01 10:04:38.602610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183bb18-2f77-4c89-9c68-c8f531d2c143 service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:38.606075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.606475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.606867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.616296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.617241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.617658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.618065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.639310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.639673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:38.641808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:38.643642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.660836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 927/1852] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:38.663487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 926/1853] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:38.716589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:38.761708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051860a7-424d-4f8b-acda-4592a425a82b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:38.771677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.772413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.772734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.773406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.784691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.791765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.800040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:38.802134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:38.803486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 928/1854] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:38.814250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23085ad-7da4-45bc-94e8-5feb7e3d5b7b service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:38.818612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:38.819305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:38.819623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:38.819864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:38.907323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:38.909476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3b4e7-478d-495b-adea-74749ec6cb8c service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:38.926102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 927/1855] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:41.990413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:41.992629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:42.089675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2cb34-2701-4930-a61f-14e8dfed778c service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:42.097602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:42.099072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:42.099455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:42.099842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] PATH_INFO: `/v3/users/d843f96920a94f5fb1e2ab41f5b0f09a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:42.102848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d843f96920a94f5fb1e2ab41f5b0f09a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:42.109835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:42.203389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd843f96920a94f5fb1e2ab41f5b0f09a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.204163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd843f96920a94f5fb1e2ab41f5b0f09a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.217471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd843f96920a94f5fb1e2ab41f5b0f09a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.231476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd843f96920a94f5fb1e2ab41f5b0f09a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.241491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd843f96920a94f5fb1e2ab41f5b0f09a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.252276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 929/1856] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:41 2022] DELETE /identity/v3/users/d843f96920a94f5fb1e2ab41f5b0f09a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:42.253695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:42.254136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:42.254249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:42.274911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:42.276434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:42.340064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 928/1857] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:42.358536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:42.360441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:42.436516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f282-fd64-4947-8623-8e9c6cf18c65 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:42.440500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:42.441663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:42.441663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:42.442008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:42.459917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:42.461592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:42.472577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 930/1858] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:42.903300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:42.904756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:42.916941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dc30d-7381-44a4-9d42-94448b595159 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:42.922015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:42.922907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:42.923215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:42.923487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] PATH_INFO: `/v3/projects/cc83e5db0ea54fb7837691f4fac4ca85` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:42.924680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc83e5db0ea54fb7837691f4fac4ca85)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:42.926634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:42.975644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc83e5db0ea54fb7837691f4fac4ca85', 'request_id': 'req-e3daef97-1372-48fc-af92-640c9d2ac584'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.983449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc83e5db0ea54fb7837691f4fac4ca85', 'request_id': 'req-e3daef97-1372-48fc-af92-640c9d2ac584'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:42.990944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc83e5db0ea54fb7837691f4fac4ca85', 'request_id': 'req-e3daef97-1372-48fc-af92-640c9d2ac584'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.005866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] The token cache is being invalidate because project cc83e5db0ea54fb7837691f4fac4ca85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:43.006441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.007319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.009233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 929/1859] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:42 2022] DELETE /identity/v3/projects/cc83e5db0ea54fb7837691f4fac4ca85 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:43.014093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.024614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019230e3-1e39-4431-979f-8741a68b9ae4 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.085529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.086669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.087163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.087710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] PATH_INFO: `/v3/users/1a3e133e332845fab9a97b0930345c79` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.089709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3e133e332845fab9a97b0930345c79)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.091945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.163798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3e133e332845fab9a97b0930345c79'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.164727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3e133e332845fab9a97b0930345c79'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.181436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3e133e332845fab9a97b0930345c79'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.198824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3e133e332845fab9a97b0930345c79'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.208198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3e133e332845fab9a97b0930345c79'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.216350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 931/1860] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:43 2022] DELETE /identity/v3/users/1a3e133e332845fab9a97b0930345c79 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:43.450292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.451877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.464696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daef97-1372-48fc-af92-640c9d2ac584 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.522200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.523474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.523759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.524045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] PATH_INFO: `/v3/users/e8efc9fd3c4846a88b9d4060efa94df1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.525261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8efc9fd3c4846a88b9d4060efa94df1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.527233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.557892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.559348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.575377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8efc9fd3c4846a88b9d4060efa94df1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.584117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8efc9fd3c4846a88b9d4060efa94df1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.584249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758e9d-d0b5-4504-bcc8-16959c2aaacb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.589607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.590588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.590974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.591374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] PATH_INFO: `/v3/projects/899f3cd6b3534765a9002af8e1917b3f` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.592678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899f3cd6b3534765a9002af8e1917b3f)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.594749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.597830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8efc9fd3c4846a88b9d4060efa94df1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.598531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8efc9fd3c4846a88b9d4060efa94df1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.599169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-518171ea-e11f-4a55-8e29-113f7b284e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8efc9fd3c4846a88b9d4060efa94df1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.611996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 930/1861] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:43 2022] DELETE /identity/v3/users/e8efc9fd3c4846a88b9d4060efa94df1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:43.616507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.616873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.617149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.635542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:43.636757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.642073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899f3cd6b3534765a9002af8e1917b3f', 'request_id': 'req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.647654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899f3cd6b3534765a9002af8e1917b3f', 'request_id': 'req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.655036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899f3cd6b3534765a9002af8e1917b3f', 'request_id': 'req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.670547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] The token cache is being invalidate because project 899f3cd6b3534765a9002af8e1917b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:43.670866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.671482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4fb85de4-f20a-46e3-80f5-5b7d7b27a557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:43.673239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 932/1862] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:43 2022] DELETE /identity/v3/projects/899f3cd6b3534765a9002af8e1917b3f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:43.678801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a842-58cd-45a7-88cb-3978b20f9313 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.679242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a842-58cd-45a7-88cb-3978b20f9313 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.679529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a842-58cd-45a7-88cb-3978b20f9313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.699096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2002a842-58cd-45a7-88cb-3978b20f9313 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:43.700411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2002a842-58cd-45a7-88cb-3978b20f9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.701690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 931/1863] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:43.708523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 933/1864] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:43.713259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.714720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.716993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.717280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.717554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.736920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:43.738110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:43.746277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 934/1865] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:43.750294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.759098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f8cb6-635a-43f4-836c-c976c0e34380 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.764696 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.765356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.766275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.766275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.766711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:43.767094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.768856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.780458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf11daf-ecf6-44e3-aa08-03ddfab053f8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.782690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 935/1866] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:04:43.784769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.785481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.785829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.786140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.786267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.795998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.797544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4e984-8224-4f6a-9a01-102c67a68913 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.797696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.803514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.804203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.807311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.807680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.808653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 932/1867] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:43.808764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.810822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.838521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 936/1868] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:43 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:43.842855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.853561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94715249-9221-4a21-a7bc-2be918798c60 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.910636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.911360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.911645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.911922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.912636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.914549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.940041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 933/1869] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:43 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:43.944261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.955232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ea7a3-2483-44fa-9d03-2b5b1c1b4ab5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.960187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.961058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.961409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.961747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.962545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.964266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:43.975605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 937/1870] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:43.979696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:43.989981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb54ab8-577b-4842-8a41-0866cffa11a3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:43.995009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:43.995868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:43.996023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:43.996280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:43.997037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:43.998784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bc71c-d1f8-488f-aa3f-6a5fa7ece5a6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.009540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 934/1871] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:44.013908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.024494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfae41-36ab-4836-895b-e430880e88aa admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.029276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.030164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.030444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.030756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] PATH_INFO: `/v3/projects/f3f1e60fcbcc44dbbdd1fedd6a72dbdf/users/cfa9525ac8884ea5bf5b8146fc8c3e25/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.046454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f1e60fcbcc44dbbdd1fedd6a72dbdf, user_id=cfa9525ac8884ea5bf5b8146fc8c3e25, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.049170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.074745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 938/1872] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:44 2022] PUT /identity/v3/projects/f3f1e60fcbcc44dbbdd1fedd6a72dbdf/users/cfa9525ac8884ea5bf5b8146fc8c3e25/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:44.077714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.078070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.078407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.108726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] MFA Rules not processed for user `cfa9525ac8884ea5bf5b8146fc8c3e25`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:44.109932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:44.190920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.194044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:44.224180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 935/1873] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:44.227393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.305375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4578d2a-004c-4ac4-9cbc-a509d0c6cd9c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.310491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.311719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.312023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.312297 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.313004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.316746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.358043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 936/1874] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:44 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:44.359295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.368517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252da0c-6bda-470f-9978-05eed0fd770c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.459037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefffcd6-d0a5-488c-9914-fc3aa27c559b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.466736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.466736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.467110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.471118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.471118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.471118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.507071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 937/1875] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:44 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:44.508414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.519467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65222ef-4526-48bc-9768-61e8504f609e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.525054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.526137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.526529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.526928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.529291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.531106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.536421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.537634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.537921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.538195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] PATH_INFO: `/v3/projects/325997ce1da745a4858a6b7f87624dc7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.540645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325997ce1da745a4858a6b7f87624dc7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.542615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.547614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 938/1876] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:44.548797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.582630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ee2f9-ce5d-42ee-9dd3-50f9e176efb8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.598395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.599289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.599574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.599853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] PATH_INFO: `/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab/users/8bd229887b494f9aa821c10d03034979/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.620350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ee5064fa3454fb184b20b8c5e54ab, user_id=8bd229887b494f9aa821c10d03034979, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.623426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.646467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 939/1877] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:44 2022] PUT /identity/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab/users/8bd229887b494f9aa821c10d03034979/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:44.647868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.651197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325997ce1da745a4858a6b7f87624dc7', 'request_id': 'req-d47d238a-001b-47fb-a422-0817b08dfd40'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.656786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325997ce1da745a4858a6b7f87624dc7', 'request_id': 'req-d47d238a-001b-47fb-a422-0817b08dfd40'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.663400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325997ce1da745a4858a6b7f87624dc7', 'request_id': 'req-d47d238a-001b-47fb-a422-0817b08dfd40'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.682412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] The token cache is being invalidate because project 325997ce1da745a4858a6b7f87624dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:44.682775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.683917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.687868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 939/1878] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:44 2022] DELETE /identity/v3/projects/325997ce1da745a4858a6b7f87624dc7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:44.692848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.694491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:44.747469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caddca2-cb5d-4ab5-bffd-7a8af26bcc08 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.753481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.754298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.754690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.755044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.756056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.758419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.773840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 940/1879] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:44.775623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:44.778038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:44.784706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d238a-001b-47fb-a422-0817b08dfd40 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.789975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.790903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.791187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.791498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] PATH_INFO: `/v3/users/90e102dcfede494a84e8a9b1cba17cd7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.792635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e102dcfede494a84e8a9b1cba17cd7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.795027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.806449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39566780-40cf-4e81-8810-6cc2b308b5ab admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:44.826576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:44.827865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.829047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.829437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] PATH_INFO: `/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab/users/8bd229887b494f9aa821c10d03034979/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.834103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ee5064fa3454fb184b20b8c5e54ab, user_id=8bd229887b494f9aa821c10d03034979, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:44.841071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c17e9-a4f1-4bed-bace-299529e6dd71 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:44.868389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 941/1880] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:44 2022] PUT /identity/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab/users/8bd229887b494f9aa821c10d03034979/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:44.878746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:44.879151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:44.879496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:44.912332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e102dcfede494a84e8a9b1cba17cd7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.913017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e102dcfede494a84e8a9b1cba17cd7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.913199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] MFA Rules not processed for user `8bd229887b494f9aa821c10d03034979`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:44.914762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:44.931084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e102dcfede494a84e8a9b1cba17cd7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.955841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e102dcfede494a84e8a9b1cba17cd7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.969348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e102dcfede494a84e8a9b1cba17cd7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:44.976029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 940/1881] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:44 2022] DELETE /identity/v3/users/90e102dcfede494a84e8a9b1cba17cd7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:45.073282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 942/1882] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:45.087522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:45.090116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:45.178184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b909bb7-a1bd-460f-b816-f54866e42c9e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:45.182420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:45.183279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:45.183832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:45.184594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:45.188121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:45.266126 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:45.267720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4415d93-21e8-45b8-a27e-8dc8b89b63dc service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:45.295266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 941/1883] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:45.343737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:45.345377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:45.454451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c686ec-493e-457f-90d0-c0446bdf5785 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:45.529351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:45.530282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:45.530568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:45.530875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] PATH_INFO: `/v3/projects/0d72e280f4574abca0171235d2d0f300` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:45.532682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d72e280f4574abca0171235d2d0f300)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:45.535224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:45.597825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d72e280f4574abca0171235d2d0f300', 'request_id': 'req-81c77ac7-f53d-45aa-a2aa-dae59526be8f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:45.605398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d72e280f4574abca0171235d2d0f300', 'request_id': 'req-81c77ac7-f53d-45aa-a2aa-dae59526be8f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:45.613923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d72e280f4574abca0171235d2d0f300', 'request_id': 'req-81c77ac7-f53d-45aa-a2aa-dae59526be8f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:45.639518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] The token cache is being invalidate because project 0d72e280f4574abca0171235d2d0f300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:45.639799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:45.646284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-81c77ac7-f53d-45aa-a2aa-dae59526be8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:45.648858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 943/1884] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:45 2022] DELETE /identity/v3/projects/0d72e280f4574abca0171235d2d0f300 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:45.653820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:45.654156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:45.654431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:45.686821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:45.688477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:45.882319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 942/1885] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:45.885966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:45.886480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:45.888475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:45.937957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:45.940865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:45.967346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:45.967960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 944/1886] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:45.983280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee227-010e-4e43-b932-e5d861cacc43 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:45.996294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:45.997498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:45.999469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.001245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.002059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:46.002685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.005250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.034707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 943/1887] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:46.039061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.053460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5749c-7f9a-406a-82e9-4d642499efd3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.058937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.059882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.060174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.060456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.061158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.063654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.122483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 945/1888] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:46.127148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.139369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88448380-95f6-4661-90f1-80fb0cd055bd admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.229895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.230687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.231040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.231554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.232456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.234999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.260214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 944/1889] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:46.264495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.275190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7a9a8-2e4d-471e-b978-e26de1accfa7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.280356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.281135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.281493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.281841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.284300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.284433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.295717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 946/1890] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:46.300251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.310239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539793-4339-4529-9233-83e9dbf2bb11 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.315257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.315958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.316245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.316522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.317421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.318957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231c340-eac4-4ef9-8d3c-0d975307e5fc admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.328999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 945/1891] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:46.333147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.343320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ee6e4-a544-4afc-80a1-f0e7ac7213c8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.348139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.349034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.349319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.349599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] PATH_INFO: `/v3/projects/269b039d1ad94b7abbac1f84414341ed/users/8b917a27dc90442d9e8a9b72ca963de0/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.364000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=269b039d1ad94b7abbac1f84414341ed, user_id=8b917a27dc90442d9e8a9b72ca963de0, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.366632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.380698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 947/1892] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:46 2022] PUT /identity/v3/projects/269b039d1ad94b7abbac1f84414341ed/users/8b917a27dc90442d9e8a9b72ca963de0/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:46.392098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.392387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.392661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.420569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] MFA Rules not processed for user `8b917a27dc90442d9e8a9b72ca963de0`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:46.422066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:46.492653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 946/1893] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:46.497311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.560429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc877e73-7f69-4d68-b0ca-7b6cc8e1d49b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.565547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.566220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.566506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.566827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.567532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.569445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.598903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 948/1894] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:46.603299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.614485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7704771f-ed04-4f3c-80c6-6c69fdefc5ac None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.671843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.672522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.672806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.673085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.673816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.675776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.702374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 947/1895] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:46.703667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.713812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c6b01-075f-40f0-943b-0e7bc3ace4d3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.719035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.719705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.720044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.720348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.721137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.722929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.735104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 949/1896] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:46.739340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.749675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234782a-13c4-481e-ac36-34bfdaf91e39 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.754986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.755925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.756171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.756522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] PATH_INFO: `/v3/projects/345dfc485d1f4c6a930c32b6ee01103d/users/f97c4b14d351431d9fece7b60f4f78ba/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.772383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345dfc485d1f4c6a930c32b6ee01103d, user_id=f97c4b14d351431d9fece7b60f4f78ba, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.775445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.790178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 948/1897] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:46 2022] PUT /identity/v3/projects/345dfc485d1f4c6a930c32b6ee01103d/users/f97c4b14d351431d9fece7b60f4f78ba/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:46.794670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.805068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d79d1-3d13-429b-8fa1-ec3c2d95edf5 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.861532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.862213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.862494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.862818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.863550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.865198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f914f01b-1c5f-4984-9588-1f4ce57fe2e5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.875524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 950/1898] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:04:46.879710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:46.890255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eab990-fce2-40c2-9d16-3c7435dd5f40 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:46.895289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:46.896258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.896578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.897085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] PATH_INFO: `/v3/projects/345dfc485d1f4c6a930c32b6ee01103d/users/f97c4b14d351431d9fece7b60f4f78ba/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.899781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=345dfc485d1f4c6a930c32b6ee01103d, user_id=f97c4b14d351431d9fece7b60f4f78ba, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:46.903142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:46.913443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 949/1899] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:46 2022] PUT /identity/v3/projects/345dfc485d1f4c6a930c32b6ee01103d/users/f97c4b14d351431d9fece7b60f4f78ba/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:46.923618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:46.923910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:46.924299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:46.949432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] MFA Rules not processed for user `f97c4b14d351431d9fece7b60f4f78ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:46.950805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:47.019368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 951/1900] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:47.031386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:47.033355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:47.096121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bed2b2-c32a-4380-9979-4ff015a4ba3e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:47.099955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:47.100619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:47.100913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:47.101194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:47.113748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:47.115282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:47.126455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 950/1901] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:47.312416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:47.313832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:47.327610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d768c-e1bf-43df-bbce-84fcd0451d94 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:47.331224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:47.331969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:47.332317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:47.332699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:47.391504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:47.392941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f2f04-31bc-4b58-b33f-6d7b0c9359b8 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:47.403861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 952/1902] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:47.774220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:47.775679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:47.840323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f5d95e-925b-440a-a0a0-fbce33156240 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:47.846368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:47.847291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:47.847578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:47.847839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] PATH_INFO: `/v3/users/e3471bda9ad3407a85135ac6bca211a9` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:47.849155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3471bda9ad3407a85135ac6bca211a9)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:47.851131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:47.899919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3471bda9ad3407a85135ac6bca211a9'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:47.900570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3471bda9ad3407a85135ac6bca211a9'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:47.909644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3471bda9ad3407a85135ac6bca211a9'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:47.925774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3471bda9ad3407a85135ac6bca211a9'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:47.932945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3471bda9ad3407a85135ac6bca211a9'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:47.939485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 951/1903] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:47 2022] DELETE /identity/v3/users/e3471bda9ad3407a85135ac6bca211a9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:47.944271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050347-3d1d-4519-b209-0535f7346561 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:47.944792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050347-3d1d-4519-b209-0535f7346561 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:47.944887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72050347-3d1d-4519-b209-0535f7346561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:47.963882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-72050347-3d1d-4519-b209-0535f7346561 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:47.965112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-72050347-3d1d-4519-b209-0535f7346561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.025079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 953/1904] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:48.035083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:48.036863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.095463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974228a-5ebc-4bfb-b1ad-efa5f0b00f18 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:48.099319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:48.099987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.100277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.100549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.109641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:48.111129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974498d0-a731-474c-8628-03ffc772ca01 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:48.121082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 952/1905] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:04:48.228993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050347-3d1d-4519-b209-0535f7346561 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:48.230511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-72050347-3d1d-4519-b209-0535f7346561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.242112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72050347-3d1d-4519-b209-0535f7346561 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:48.246999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:48.247892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.248212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.248436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] PATH_INFO: `/v3/users/cfa9525ac8884ea5bf5b8146fc8c3e25` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.252000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa9525ac8884ea5bf5b8146fc8c3e25)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:48.252000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:48.312152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa9525ac8884ea5bf5b8146fc8c3e25'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.324374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa9525ac8884ea5bf5b8146fc8c3e25'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.336960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa9525ac8884ea5bf5b8146fc8c3e25'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.337674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa9525ac8884ea5bf5b8146fc8c3e25'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.338274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa9525ac8884ea5bf5b8146fc8c3e25'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.351747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 954/1906] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:48 2022] DELETE /identity/v3/users/cfa9525ac8884ea5bf5b8146fc8c3e25 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:48.356344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.356690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.357006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.376651 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:48.378266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.404215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:48.405866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.458119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 953/1907] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:48.471437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:48.472790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.475402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85000de4-69f5-4b0a-bbd4-4e1c3516caf9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:48.480153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:48.481021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.481325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.481590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] PATH_INFO: `/v3/projects/db6891de1e6f4196997f56e4993967d4` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.482822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6891de1e6f4196997f56e4993967d4)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:48.484706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:48.533416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6891de1e6f4196997f56e4993967d4', 'request_id': 'req-19fabab3-bb1e-4e99-9c84-c447d13e705c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.536673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c398de-c80c-4e1a-a328-9384ae3bf9ab None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:48.538771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6891de1e6f4196997f56e4993967d4', 'request_id': 'req-19fabab3-bb1e-4e99-9c84-c447d13e705c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.546133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6891de1e6f4196997f56e4993967d4', 'request_id': 'req-19fabab3-bb1e-4e99-9c84-c447d13e705c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.570132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] The token cache is being invalidate because project db6891de1e6f4196997f56e4993967d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:48.570422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.571115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.572706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 955/1908] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:48 2022] DELETE /identity/v3/projects/db6891de1e6f4196997f56e4993967d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:48.576901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:48.578636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.600909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:48.601783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.601898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.602131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.603947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:48.643523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fabab3-bb1e-4e99-9c84-c447d13e705c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:48.648790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:48.649777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:48.650151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:48.650614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] PATH_INFO: `/v3/users/cf921f6ba29a4ff9bcb5f40f213321e8` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:48.652005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf921f6ba29a4ff9bcb5f40f213321e8)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:48.654063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:48.675997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:48.677436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:48.689856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 954/1909] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:48.703366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf921f6ba29a4ff9bcb5f40f213321e8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.714947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf921f6ba29a4ff9bcb5f40f213321e8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.731238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf921f6ba29a4ff9bcb5f40f213321e8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.732306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf921f6ba29a4ff9bcb5f40f213321e8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.733116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf921f6ba29a4ff9bcb5f40f213321e8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:48.747916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 956/1910] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:48 2022] DELETE /identity/v3/users/cf921f6ba29a4ff9bcb5f40f213321e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:49.007012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.008552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.025092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203d3b7-23ce-4263-999d-b4fca8ac1110 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.048167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.049746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.101694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.102749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.103099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.103439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] PATH_INFO: `/v3/projects/f3f1e60fcbcc44dbbdd1fedd6a72dbdf` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.104703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f1e60fcbcc44dbbdd1fedd6a72dbdf)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.106840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.124315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41861c1d-99c3-47f1-ad09-2b05e2de71d9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.129956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.130881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.131163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.131641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] PATH_INFO: `/v3/projects/0ee9529ccf8943cb9bf57be8859b781a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.133310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee9529ccf8943cb9bf57be8859b781a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.135005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.155520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f1e60fcbcc44dbbdd1fedd6a72dbdf', 'request_id': 'req-9d06cb3c-664c-46f1-8602-6852dd20b6f0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.161632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f1e60fcbcc44dbbdd1fedd6a72dbdf', 'request_id': 'req-9d06cb3c-664c-46f1-8602-6852dd20b6f0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.168099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f1e60fcbcc44dbbdd1fedd6a72dbdf', 'request_id': 'req-9d06cb3c-664c-46f1-8602-6852dd20b6f0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.183285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] The token cache is being invalidate because project f3f1e60fcbcc44dbbdd1fedd6a72dbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:49.183858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.184589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.189400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 955/1911] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:49 2022] DELETE /identity/v3/projects/f3f1e60fcbcc44dbbdd1fedd6a72dbdf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:49.190891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.191432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee9529ccf8943cb9bf57be8859b781a', 'request_id': 'req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.192547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.198693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee9529ccf8943cb9bf57be8859b781a', 'request_id': 'req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.205854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee9529ccf8943cb9bf57be8859b781a', 'request_id': 'req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.222448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] The token cache is being invalidate because project 0ee9529ccf8943cb9bf57be8859b781a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:49.222767 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.223749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-65fd1a0d-a32f-4b5f-a9e6-00a9287eda5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.225664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 957/1912] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:49 2022] DELETE /identity/v3/projects/0ee9529ccf8943cb9bf57be8859b781a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:49.230533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d283-8709-450c-9e2c-f546d3997e64 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.230917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d283-8709-450c-9e2c-f546d3997e64 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.231258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d283-8709-450c-9e2c-f546d3997e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.249576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b783d283-8709-450c-9e2c-f546d3997e64 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:49.250880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b783d283-8709-450c-9e2c-f546d3997e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.260737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06cb3c-664c-46f1-8602-6852dd20b6f0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.308642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 958/1913] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:49.316472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.316763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.317040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.320460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.321515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.321804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.322085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] PATH_INFO: `/v3/users/8bd229887b494f9aa821c10d03034979` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.327259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd229887b494f9aa821c10d03034979)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.329411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.335477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:49.336708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.352997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 959/1914] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:49.354155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.364531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5eb8ef-b7c7-4d17-ae10-85ccd7be41a9 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.370188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.370893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.371173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.371720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.372148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:49.372563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.374199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.385848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 960/1915] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:04:49.390067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.392339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd229887b494f9aa821c10d03034979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.392946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd229887b494f9aa821c10d03034979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.401337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a058a-aff3-4258-aa11-ebb7e0c0e82a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.402328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd229887b494f9aa821c10d03034979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.407864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.409144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.409408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.409827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.410618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.412689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.415790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd229887b494f9aa821c10d03034979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.422965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd229887b494f9aa821c10d03034979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:49.430068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 956/1916] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:04:49 2022] DELETE /identity/v3/users/8bd229887b494f9aa821c10d03034979 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:49.447089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 961/1917] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:04:49.448300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.452160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.544808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d94ddd-aad8-413d-9dd5-e4f016affe06 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.616386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.617038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.617446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.618259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.618847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.620954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.648767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 957/1918] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:49 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:49.652837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.666230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a3c63-098a-430c-82f5-8c095ed59b72 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.673831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.675014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.675363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.675813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.676651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.678958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.697725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 962/1919] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:49.701839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.715942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeb8e2-564c-4e15-9b54-4f35e7fbb223 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.733932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.734848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.735136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.736011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.747131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.749127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e5e5b-4cb4-4ee9-aa09-027c4b4e3b2e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.766825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 958/1920] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:49.767695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.778712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e7193-fadc-4c82-a85d-2750170ddb71 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:49.783770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:49.784687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.784972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.785247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] PATH_INFO: `/v3/projects/625cdea4b2e146798727e900b8b9d00b/users/1a44657fb9194a678c44291c106888f2/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.805321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625cdea4b2e146798727e900b8b9d00b, user_id=1a44657fb9194a678c44291c106888f2, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:49.809041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:49.838909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 963/1921] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:49 2022] PUT /identity/v3/projects/625cdea4b2e146798727e900b8b9d00b/users/1a44657fb9194a678c44291c106888f2/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:49.849148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:49.849502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:49.849726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:49.913167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] MFA Rules not processed for user `1a44657fb9194a678c44291c106888f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:49.914684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:49.935064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:49.936818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.026826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a54b49-e3dc-4352-860a-8281aa0603a8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.032184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 959/1922] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:50.037807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.038953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.039233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.039502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] PATH_INFO: `/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.041020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2ee5064fa3454fb184b20b8c5e54ab)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.041434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.042978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.043226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.096192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2ee5064fa3454fb184b20b8c5e54ab', 'request_id': 'req-d0e92473-2c28-43f8-815c-a7f650d9d9b8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:50.102608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067b810-f8ab-4488-a589-4e50485e9cde None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.103378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2ee5064fa3454fb184b20b8c5e54ab', 'request_id': 'req-d0e92473-2c28-43f8-815c-a7f650d9d9b8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:50.110073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2ee5064fa3454fb184b20b8c5e54ab', 'request_id': 'req-d0e92473-2c28-43f8-815c-a7f650d9d9b8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:50.124431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] The token cache is being invalidate because project be2ee5064fa3454fb184b20b8c5e54ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:04:50.124724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:50.125368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d0e92473-2c28-43f8-815c-a7f650d9d9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:04:50.127017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 964/1923] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:04:49 2022] DELETE /identity/v3/projects/be2ee5064fa3454fb184b20b8c5e54ab => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:04:50.131736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894866-ebf7-49b7-9f18-370716a7ba19 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.132021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894866-ebf7-49b7-9f18-370716a7ba19 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.132296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894866-ebf7-49b7-9f18-370716a7ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.150563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c8894866-ebf7-49b7-9f18-370716a7ba19 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:50.151900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c8894866-ebf7-49b7-9f18-370716a7ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.152706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.153421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.153734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.154013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.155819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.207321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 965/1924] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:50.212337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.213796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.215157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.215452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.215730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.223179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 960/1925] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:04:50.234017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:50.235238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.246069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 966/1926] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:04:50.250931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.264741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ecc2e-65d7-4d57-9aae-bc8494c23825 service glance] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.271712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.272769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.273532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.273825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.275008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:04:50.275319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.276940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.294693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 961/1927] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:04:50.295783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.305730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef55fd-fa3a-41e6-beb3-149c08172212 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.311749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.312629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.312921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.313987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.314669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.316588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.350619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 967/1928] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:04:50 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:50.352229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.363638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9381347-e862-44d8-bb83-d55f784d9961 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.431962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.432788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.433161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.433569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.434268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.436688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.462190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 962/1929] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:04:50 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:04:50.463696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.475842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe890b-7daf-464b-a59e-86a299f05594 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.480724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.481477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.481890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.482231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.483076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.484775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.497244 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 968/1930] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:50.501534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.512552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f7564-dd00-40d5-81ef-00acb808735e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.518167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.518889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.519178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.519456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.520202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.521949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da0267-9a82-46e1-92df-d30ca3500292 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.533431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 963/1931] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:04:50.537730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.548262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d209e2-9ec4-473a-b125-9e390544a953 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.552996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.553893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.554180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.554458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] PATH_INFO: `/v3/projects/ab9c1f1b8c844e89ae17a2817fbdc8b1/users/87dfffdf4d7a434dac3681c400f4e5cf/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.572054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab9c1f1b8c844e89ae17a2817fbdc8b1, user_id=87dfffdf4d7a434dac3681c400f4e5cf, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.574770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.588564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 969/1932] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:04:50 2022] PUT /identity/v3/projects/ab9c1f1b8c844e89ae17a2817fbdc8b1/users/87dfffdf4d7a434dac3681c400f4e5cf/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:04:50.601166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.601378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.601702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.639933 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] MFA Rules not processed for user `87dfffdf4d7a434dac3681c400f4e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:04:50.641692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.712224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 964/1933] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:04:50.724088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:04:50.725905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:04:50.784485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce3a5-2425-4a8c-bf45-94b6a7efafcd admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:04:50.788210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:04:50.788876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:04:50.789155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:04:50.789426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:04:50.798530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:04:50.800114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901ef6-fa41-481e-9d60-ec90ca80b0e9 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:04:50.809319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 970/1934] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:08.954252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:08.956549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:09.049537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293568d-9638-44e2-ae85-2632c9607e10 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:09.054339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:09.055510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:09.056694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:09.056973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] PATH_INFO: `/v3/users/8b917a27dc90442d9e8a9b72ca963de0` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:09.058342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b917a27dc90442d9e8a9b72ca963de0)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:09.061103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:09.131410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b917a27dc90442d9e8a9b72ca963de0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:09.132019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b917a27dc90442d9e8a9b72ca963de0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:09.143085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b917a27dc90442d9e8a9b72ca963de0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:09.155585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b917a27dc90442d9e8a9b72ca963de0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:09.162286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b917a27dc90442d9e8a9b72ca963de0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:09.168745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 965/1935] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:08 2022] DELETE /identity/v3/users/8b917a27dc90442d9e8a9b72ca963de0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:09.173444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:09.173979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:09.174060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:09.194532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:09.195924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:09.269225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 971/1936] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:09.277027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:09.278689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:09.343437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c00b-e060-4574-9611-5ba25bbbd21c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:09.347650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:09.348330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:09.348616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:09.348895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:09.358760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:09.360490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:09.370764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 966/1937] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:10.001829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:10.006428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:10.026335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04150869-8cc6-4307-9a2d-5d94e149ec26 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:10.032900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:10.033996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:10.034501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:10.034910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] PATH_INFO: `/v3/projects/269b039d1ad94b7abbac1f84414341ed` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:10.036493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269b039d1ad94b7abbac1f84414341ed)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:10.038686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:10.111961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269b039d1ad94b7abbac1f84414341ed', 'request_id': 'req-e1b38545-f74e-4419-aa2a-ebb983af3b79'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.117235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269b039d1ad94b7abbac1f84414341ed', 'request_id': 'req-e1b38545-f74e-4419-aa2a-ebb983af3b79'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.123726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269b039d1ad94b7abbac1f84414341ed', 'request_id': 'req-e1b38545-f74e-4419-aa2a-ebb983af3b79'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.139855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] The token cache is being invalidate because project 269b039d1ad94b7abbac1f84414341ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:10.140152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.140863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.145974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 972/1938] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:10 2022] DELETE /identity/v3/projects/269b039d1ad94b7abbac1f84414341ed => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:10.147163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:10.159116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bedb98-0155-420d-b1fa-52d1bfe0fbcf service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:10.233248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:10.234690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:10.235038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:10.235275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] PATH_INFO: `/v3/users/f97c4b14d351431d9fece7b60f4f78ba` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:10.237138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97c4b14d351431d9fece7b60f4f78ba)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:10.239331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:10.292441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97c4b14d351431d9fece7b60f4f78ba'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.293307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97c4b14d351431d9fece7b60f4f78ba'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.302601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97c4b14d351431d9fece7b60f4f78ba'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.315354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97c4b14d351431d9fece7b60f4f78ba'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.323534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0445a7c2-8d64-4407-892c-2498f5e494e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97c4b14d351431d9fece7b60f4f78ba'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.330499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 967/1939] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:10 2022] DELETE /identity/v3/users/f97c4b14d351431d9fece7b60f4f78ba => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:10.773322 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:10.775503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:10.809685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b38545-f74e-4419-aa2a-ebb983af3b79 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:10.867409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:10.868328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:10.868606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:10.868882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] PATH_INFO: `/v3/projects/345dfc485d1f4c6a930c32b6ee01103d` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:10.870160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=345dfc485d1f4c6a930c32b6ee01103d)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:10.872134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:10.927438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345dfc485d1f4c6a930c32b6ee01103d', 'request_id': 'req-cb43ee0a-ead5-4d10-851f-71213ce01aba'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.933461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345dfc485d1f4c6a930c32b6ee01103d', 'request_id': 'req-cb43ee0a-ead5-4d10-851f-71213ce01aba'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.940859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345dfc485d1f4c6a930c32b6ee01103d', 'request_id': 'req-cb43ee0a-ead5-4d10-851f-71213ce01aba'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.957623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] The token cache is being invalidate because project 345dfc485d1f4c6a930c32b6ee01103d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:10.958144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.961938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cb43ee0a-ead5-4d10-851f-71213ce01aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:10.965666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 973/1940] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:10 2022] DELETE /identity/v3/projects/345dfc485d1f4c6a930c32b6ee01103d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:10.967496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:10.968002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:10.968459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:10.990355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:10.991269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:11.075889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 968/1941] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:11.083958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.084253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.084588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.106762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:11.107915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:11.131583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 974/1942] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:11.135215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.144935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cef034-9d0f-488f-b5e8-e3a5bb801c33 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.150513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.151236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.151515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.151794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.152538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:11.152843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.154471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.166916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 969/1943] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:11.171359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.181237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dafcc9-f80e-4f3c-8fdd-5043e0defef3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.186172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.186948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.187236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.196829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.196829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.196829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.229823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 975/1944] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:11 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:11.233891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.245113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b54ce-3e67-49d3-a8a8-cc6a2964d305 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.308633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.309436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.309789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.310181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.311085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.314690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.344213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 970/1945] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:11 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:11.348841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.363306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad2249-3673-4867-af57-3e6c396abce9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.368227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.368979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.369335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.369679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.370499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.372272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.382598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 976/1946] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:11.386636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.396702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57b44-814a-4cf9-8386-e09f01a8227d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.401742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.402414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.402737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.403021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.403751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.405364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a728b-09f8-4ac6-b654-43d2f13b1593 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.415288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 971/1947] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:05:11.419402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.429502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7392e9c-5387-4844-ae09-4b6d195d5369 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.434972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.435883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.436167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.436440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] PATH_INFO: `/v3/projects/fb1cfa67364c44cbb6a14dae79f3f3e2/users/44c2155428ef4d84942b43e1c27a3352/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.451262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1cfa67364c44cbb6a14dae79f3f3e2, user_id=44c2155428ef4d84942b43e1c27a3352, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.454106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.469613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 977/1948] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:11 2022] PUT /identity/v3/projects/fb1cfa67364c44cbb6a14dae79f3f3e2/users/44c2155428ef4d84942b43e1c27a3352/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:11.481241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.481609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.481956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.511905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] MFA Rules not processed for user `44c2155428ef4d84942b43e1c27a3352`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:11.513119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:11.582281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 972/1949] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:11.593724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:11.595514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:11.651681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473802ba-b8f5-4a2b-9d63-609c56980c1c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:11.655703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:11.656363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:11.656716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:11.656963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:11.665656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:11.667132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:11.676096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 978/1950] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:29.957891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:29.959396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:30.028686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fa17-5c24-434c-a854-77f98c62ad4b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.035231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.036120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.036398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.036669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] PATH_INFO: `/v3/users/dd3b377ae39b4f2387db5fb30716aff3` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.037941 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3b377ae39b4f2387db5fb30716aff3)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.039914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.091408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3b377ae39b4f2387db5fb30716aff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.092043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3b377ae39b4f2387db5fb30716aff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.099960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3b377ae39b4f2387db5fb30716aff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.111529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3b377ae39b4f2387db5fb30716aff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.117927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5bc98e83-5a4f-42f8-ad8e-7d41a527e405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3b377ae39b4f2387db5fb30716aff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.123967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 973/1951] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:29 2022] DELETE /identity/v3/users/dd3b377ae39b4f2387db5fb30716aff3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:30.295551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.308522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baffb8-88b0-4ef2-8e07-0fe68f091c35 service glance] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.373342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.374209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.374483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.374795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] PATH_INFO: `/v3/projects/a3b3649989d44826a64e8a7ee24dbf90` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.375997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b3649989d44826a64e8a7ee24dbf90)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.377970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.424683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b3649989d44826a64e8a7ee24dbf90', 'request_id': 'req-d3e815fd-878f-4214-8279-e4596b8318a5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.431092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b3649989d44826a64e8a7ee24dbf90', 'request_id': 'req-d3e815fd-878f-4214-8279-e4596b8318a5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.437635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b3649989d44826a64e8a7ee24dbf90', 'request_id': 'req-d3e815fd-878f-4214-8279-e4596b8318a5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.455019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] The token cache is being invalidate because project a3b3649989d44826a64e8a7ee24dbf90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:30.455243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.456114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d3e815fd-878f-4214-8279-e4596b8318a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:30.458527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 979/1952] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:30 2022] DELETE /identity/v3/projects/a3b3649989d44826a64e8a7ee24dbf90 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:30.465182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.465476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.465753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.484984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:30.486189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:30.558979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 974/1953] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:30.567282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.567572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.567851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.587298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:30.588517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:30.598291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 980/1954] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:30.604555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.614630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104377a0-93bf-47de-af3b-e8de6a048a9e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.620498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.621145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.621428 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.621694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.622991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:30.623297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.624896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.636819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 975/1955] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:05:30.641849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.656417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9b4cd-8dfb-4ee7-bfed-e1b96698743c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.665813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.666955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.667253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.667511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.668199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.670064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.699844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 981/1956] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:30 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:30.704200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.715555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd5bc4-6f05-44e7-a402-8bb814e8e1e0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.773687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.774374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.774673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.774963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.775680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.777624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.800228 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 976/1957] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:30 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:30.801432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.811734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330458a-5cca-4ca1-8a52-13d4bfb618d6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.816459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.817124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.817413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.817695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.818428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.820080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.830310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 982/1958] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:30.834142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.844363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847ea43-3025-4509-a163-6b0dd215ac1b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.849139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.849795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.850077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.850351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.851115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.852710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438de657-fec6-4766-9676-14eb2d5eb779 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.862514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 977/1959] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:30.866520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:30.876626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822a24f-51c6-4482-89fa-0b911ddc032a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:30.881385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:30.882262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.882550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.882851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] PATH_INFO: `/v3/projects/b82a9990d0af48af801f87b1f762d9a9/users/cab049852d074af28c85fc342b4523b1/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.896859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b82a9990d0af48af801f87b1f762d9a9, user_id=cab049852d074af28c85fc342b4523b1, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:30.899850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:30.913468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 983/1960] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:30 2022] PUT /identity/v3/projects/b82a9990d0af48af801f87b1f762d9a9/users/cab049852d074af28c85fc342b4523b1/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:30.924614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:30.925083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:30.925484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:30.955362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] MFA Rules not processed for user `cab049852d074af28c85fc342b4523b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:30.956558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:31.026000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 978/1961] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:31.037023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:31.039178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:31.097509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8402-345d-4fee-9d67-4f745ead692b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:31.101385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:31.102028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:31.102307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:31.102581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:31.111120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:31.112531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e931c-c21a-4c79-b950-5f84ac7799c7 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:31.121478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 984/1962] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:38.936191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:38.938335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:39.015848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772b1d3-2ab5-49a6-8602-aaa652a5bba0 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:39.020841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:39.021721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:39.022319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:39.022640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] PATH_INFO: `/v3/users/e6268b99f79748cbaf5d9615881c9462` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:39.023921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6268b99f79748cbaf5d9615881c9462)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:39.025837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:39.076759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6268b99f79748cbaf5d9615881c9462'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.077506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6268b99f79748cbaf5d9615881c9462'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.085115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6268b99f79748cbaf5d9615881c9462'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.102109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6268b99f79748cbaf5d9615881c9462'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.110114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6268b99f79748cbaf5d9615881c9462'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.116160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 979/1963] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:38 2022] DELETE /identity/v3/users/e6268b99f79748cbaf5d9615881c9462 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:39.120957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:39.121430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:39.121531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:39.140819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:39.142052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:39.207735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 985/1964] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:39.218379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:39.219805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:39.277356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5141-fdaa-41c6-b972-be84b1dd7505 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:39.281024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:39.281716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:39.281997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:39.282252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:39.292025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:39.293574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:39.306058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 980/1965] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:39.626793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:39.628405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:39.641870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366ad2-219b-49d5-a33a-c715cd9f642e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:39.647739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:39.648805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:39.649190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:39.649575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] PATH_INFO: `/v3/projects/d809a41b7639455c9fa61884742a5e87` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:39.650863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d809a41b7639455c9fa61884742a5e87)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:39.653264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:39.703746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd809a41b7639455c9fa61884742a5e87', 'request_id': 'req-6858cbd9-5955-4490-b044-c5d8a5634dd0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.709366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd809a41b7639455c9fa61884742a5e87', 'request_id': 'req-6858cbd9-5955-4490-b044-c5d8a5634dd0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.715538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd809a41b7639455c9fa61884742a5e87', 'request_id': 'req-6858cbd9-5955-4490-b044-c5d8a5634dd0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.728623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] The token cache is being invalidate because project d809a41b7639455c9fa61884742a5e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:39.728947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.729566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.731157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 986/1966] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:39 2022] DELETE /identity/v3/projects/d809a41b7639455c9fa61884742a5e87 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:39.735622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:39.745076 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1259-101d-4fe3-aa58-15bc360fa34d service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:39.804472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:39.805351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:39.805635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:39.805910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] PATH_INFO: `/v3/users/1a9ffe4f48474eb9a41b048925e4b077` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:39.807135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9ffe4f48474eb9a41b048925e4b077)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:39.809046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:39.859490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9ffe4f48474eb9a41b048925e4b077'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.860164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9ffe4f48474eb9a41b048925e4b077'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.869739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9ffe4f48474eb9a41b048925e4b077'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.882918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9ffe4f48474eb9a41b048925e4b077'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.889707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed2d9fbd-b1ba-49c5-acb6-8e73c120f1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9ffe4f48474eb9a41b048925e4b077'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:39.896128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 981/1967] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:39 2022] DELETE /identity/v3/users/1a9ffe4f48474eb9a41b048925e4b077 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:40.163883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.165336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.181009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858cbd9-5955-4490-b044-c5d8a5634dd0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.241901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.242816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.243094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.243417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] PATH_INFO: `/v3/projects/e17ff6bdab674f10b7531eb9710fa192` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.245574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17ff6bdab674f10b7531eb9710fa192)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.246533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.298814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17ff6bdab674f10b7531eb9710fa192', 'request_id': 'req-d5b39dc3-0d17-44eb-9345-63edf4308b5c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.304567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17ff6bdab674f10b7531eb9710fa192', 'request_id': 'req-d5b39dc3-0d17-44eb-9345-63edf4308b5c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.311077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17ff6bdab674f10b7531eb9710fa192', 'request_id': 'req-d5b39dc3-0d17-44eb-9345-63edf4308b5c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.325856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] The token cache is being invalidate because project e17ff6bdab674f10b7531eb9710fa192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:40.326012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.326994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d5b39dc3-0d17-44eb-9345-63edf4308b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.328993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 987/1968] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:40 2022] DELETE /identity/v3/projects/e17ff6bdab674f10b7531eb9710fa192 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:40.334280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.335093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.335376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.363456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:40.364743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.427974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 982/1969] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:40.435650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.436074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.436444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.461130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:40.462335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.477651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 988/1970] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:40.483649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.502366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430503-9ed5-4d34-9c08-c3c31c474479 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.510791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.511544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.511911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.512308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.513470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:40.513938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.518906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.532195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 983/1971] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:40.536940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.546819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c576f-b8ca-49e1-941f-1b3a5a88d50a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.554881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.555652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.556033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.556940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.557641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.565221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.602246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 989/1972] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:40.606532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.621921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf09cd-9be6-40a7-966d-10d34701510a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.696470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.697158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.697616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.697725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.698413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.700596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.704770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.706559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.720904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944381f-917b-4bbf-b322-bb72e94de7c5 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.723602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 984/1973] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:40.726473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.727615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.727817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.728326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.728850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] PATH_INFO: `/v3/users/87dfffdf4d7a434dac3681c400f4e5cf` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.730158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dfffdf4d7a434dac3681c400f4e5cf)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.732222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.737824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7d48a-571b-4165-af3b-0dcd04db198e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.742555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.743260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.743545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.743821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.744609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.746508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.756897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 985/1974] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:40.761040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.771299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da65a-01cc-499a-9654-f85090280494 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.776742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.777724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.778015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.778297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.779064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.780707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.790616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dfffdf4d7a434dac3681c400f4e5cf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.793501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 986/1975] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:05:40.797845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.800016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dfffdf4d7a434dac3681c400f4e5cf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.809943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c2f2-2f75-406f-a937-90007d8d4471 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:40.815053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:40.816209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.816404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dfffdf4d7a434dac3681c400f4e5cf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.816517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.816780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] PATH_INFO: `/v3/projects/08f75b7a96244e86bedd7ff753d622f9/users/6415ad2868c2417c8f583aed30b2a1ae/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.817256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dfffdf4d7a434dac3681c400f4e5cf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.818108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de0d3ae-5679-4ec5-aebd-a0e5197eb5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dfffdf4d7a434dac3681c400f4e5cf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:40.831949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 990/1976] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:40 2022] DELETE /identity/v3/users/87dfffdf4d7a434dac3681c400f4e5cf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:40.837384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.838334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.839664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.844705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f75b7a96244e86bedd7ff753d622f9, user_id=6415ad2868c2417c8f583aed30b2a1ae, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:40.847563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fff88b-a254-4e99-a7c3-431392ea6088 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:40.861741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:40.863636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.874875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 987/1977] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:40 2022] PUT /identity/v3/projects/08f75b7a96244e86bedd7ff753d622f9/users/6415ad2868c2417c8f583aed30b2a1ae/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:40.887174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:40.888082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:40.888617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:40.928785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] MFA Rules not processed for user `6415ad2868c2417c8f583aed30b2a1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:40.930223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:40.962125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 991/1978] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:40.972053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:40.975493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.030858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 988/1979] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:41.035558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.037297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.052603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58099e-41d1-43c3-b599-e7117dc3f3d8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.052783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc3e0-b8f2-4bc8-b2cf-bc11fe1f6b43 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.057289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.057947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.058233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.058512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.059175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.060053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.060560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.061044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.061936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.064107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.069130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.071006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.085412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 992/1980] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:41.093916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 989/1981] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:41.097828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.109873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55851ef9-7f0c-4f37-b6f4-647cbe89ef06 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.173705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.174573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.174904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.175183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.175909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.178169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.207084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 993/1982] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:41.210939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.222427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0597-6cb3-4953-834b-34ca13e752a6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.228755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.229023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.229303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.230080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.231004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.232784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.245378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 990/1983] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:41.251714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.270962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8ebc0-54b3-41e8-b8f3-e6171b7949ce admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.277153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.278470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.278953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.279407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] PATH_INFO: `/v3/projects/b9c92927633a4107a5051cfb0714f4f8/users/b676ca8c889e4ac080eb01caba09a3a8/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.315645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c92927633a4107a5051cfb0714f4f8, user_id=b676ca8c889e4ac080eb01caba09a3a8, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.319593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.340531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 994/1984] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:41 2022] PUT /identity/v3/projects/b9c92927633a4107a5051cfb0714f4f8/users/b676ca8c889e4ac080eb01caba09a3a8/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:41.344908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.359733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3c666-2d34-4508-800a-540ca78082e0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.458366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.459460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.459730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.460159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.461155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.463095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.481609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.484626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.508906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021ba50-429b-493f-b510-539fbe39b66e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.509396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 991/1985] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:41.519086 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.520976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.521452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.522331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.522795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] PATH_INFO: `/v3/projects/ab9c1f1b8c844e89ae17a2817fbdc8b1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.524423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab9c1f1b8c844e89ae17a2817fbdc8b1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.526847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.546560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c947772-50bf-451e-8b3a-5a9eca85c5d8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.552580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.554249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.555569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.555980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] PATH_INFO: `/v3/projects/b9c92927633a4107a5051cfb0714f4f8/users/b676ca8c889e4ac080eb01caba09a3a8/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.560195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c92927633a4107a5051cfb0714f4f8, user_id=b676ca8c889e4ac080eb01caba09a3a8, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.566859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792743f3-629a-4a0b-92f8-eb507cd988f6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.579891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 992/1986] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:41 2022] PUT /identity/v3/projects/b9c92927633a4107a5051cfb0714f4f8/users/b676ca8c889e4ac080eb01caba09a3a8/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:41.591648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb2401-73fb-484d-82c8-1898a03ea1f1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.591981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb2401-73fb-484d-82c8-1898a03ea1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.592407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb2401-73fb-484d-82c8-1898a03ea1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.612179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab9c1f1b8c844e89ae17a2817fbdc8b1', 'request_id': 'req-47687155-50e2-4df4-994d-4f9b03d00cd5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.621365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab9c1f1b8c844e89ae17a2817fbdc8b1', 'request_id': 'req-47687155-50e2-4df4-994d-4f9b03d00cd5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.629271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab9c1f1b8c844e89ae17a2817fbdc8b1', 'request_id': 'req-47687155-50e2-4df4-994d-4f9b03d00cd5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.639730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d6eb2401-73fb-484d-82c8-1898a03ea1f1 None None] MFA Rules not processed for user `b676ca8c889e4ac080eb01caba09a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:41.641328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d6eb2401-73fb-484d-82c8-1898a03ea1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.643680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] The token cache is being invalidate because project ab9c1f1b8c844e89ae17a2817fbdc8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:41.644237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.644919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.646598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 995/1987] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:41 2022] DELETE /identity/v3/projects/ab9c1f1b8c844e89ae17a2817fbdc8b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:41.647705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.649260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.713718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 993/1988] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:41.715008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.715361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.716573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.716733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47687155-50e2-4df4-994d-4f9b03d00cd5 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.721933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.722907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.723217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.723490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] PATH_INFO: `/v3/users/1a44657fb9194a678c44291c106888f2` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.725071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a44657fb9194a678c44291c106888f2)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.727042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.736897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:41.738087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.746110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 994/1989] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:41.751980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.751980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.780093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a44657fb9194a678c44291c106888f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.791426 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a44657fb9194a678c44291c106888f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.806170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a44657fb9194a678c44291c106888f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.807730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a44657fb9194a678c44291c106888f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.808474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3d3b1f82-3ffb-4f2d-a6c8-1b704a98e495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a44657fb9194a678c44291c106888f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:41.810955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0199-8e2a-4f84-a021-a0674420c998 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.814517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.815220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.815502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.815775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.817895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.823170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 996/1990] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:41 2022] DELETE /identity/v3/users/1a44657fb9194a678c44291c106888f2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:41.824589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.824886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.825160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.835639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.837120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685ea7-a9cd-4d29-beff-72e5eba60e9f service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.843210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:41.844427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.847222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 995/1991] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:41.848501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.848775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.849077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.866877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:41.868153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.919613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 997/1992] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:41.926145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.932071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 996/1993] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:41.935643 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9be5-58c6-489e-ae23-1996f4a2b91e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.940236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.940902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.941189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.941468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.942014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.942194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:41.942505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.943663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:41.944276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:41.956196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 998/1994] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:41.961065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:41.971689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f100-9cdc-4c83-a34d-1dfd32304849 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:41.976589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:41.977057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:41.977341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:41.977617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:41.978434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:41.980411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.003993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea531bb4-b68a-4b2f-a9d3-3811c056a05f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.008028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.008678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.008957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.009233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.015147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 999/1995] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:42.018679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.027075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.028505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.042713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 997/1996] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:05:42.096210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686c5e7-8f25-4f4a-8762-c11a57c06add admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.102859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.102859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.102859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.102859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.103183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.105036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.130691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1000/1997] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:42.132325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.144534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec88c59-89c5-479f-9c4b-794728fe191f service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.153583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.154367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.154798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.155105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.156181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.157855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.173606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 998/1998] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:42.178235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.189646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b329b-1b56-42ff-919f-e1029bf86162 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.197343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.198031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.198315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.198615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.199398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.201180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772b044-a8d3-4800-b5a0-e3a324f619a4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.211632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1001/1999] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:42.215714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.229521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3277624-0aa5-4d34-be2a-fa65ad043f5a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.234443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.235371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.235659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.235929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] PATH_INFO: `/v3/projects/120836c9ed9d4e8082451071e35c7cd1/users/3303398e0bdd49ceb5d0fb53775b7efc/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.250783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120836c9ed9d4e8082451071e35c7cd1, user_id=3303398e0bdd49ceb5d0fb53775b7efc, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.256295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.276443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 999/2000] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:42 2022] PUT /identity/v3/projects/120836c9ed9d4e8082451071e35c7cd1/users/3303398e0bdd49ceb5d0fb53775b7efc/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:42.288351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.288636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.289173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.295639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.298421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.316924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] MFA Rules not processed for user `3303398e0bdd49ceb5d0fb53775b7efc`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:42.318135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.366222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363ddd3-9631-4a23-9bf8-8329a6133e07 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.372158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.373057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.373333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.373598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] PATH_INFO: `/v3/users/6415ad2868c2417c8f583aed30b2a1ae` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.374833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6415ad2868c2417c8f583aed30b2a1ae)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.376830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.391761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1002/2001] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:42.392804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.394352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.408604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5ceb-d673-4e08-bf6e-b6c5f3ba48d2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.413374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.414245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.414551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.414854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] PATH_INFO: `/v3/projects/625cdea4b2e146798727e900b8b9d00b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.416085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625cdea4b2e146798727e900b8b9d00b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.418012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.425900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6415ad2868c2417c8f583aed30b2a1ae'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.426638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6415ad2868c2417c8f583aed30b2a1ae'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.435237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6415ad2868c2417c8f583aed30b2a1ae'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.448727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6415ad2868c2417c8f583aed30b2a1ae'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.455426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6415ad2868c2417c8f583aed30b2a1ae'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.462021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1000/2002] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:42 2022] DELETE /identity/v3/users/6415ad2868c2417c8f583aed30b2a1ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:42.463506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.465727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.472044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625cdea4b2e146798727e900b8b9d00b', 'request_id': 'req-06577f87-cc40-4049-9c97-04c93777eae5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.478845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625cdea4b2e146798727e900b8b9d00b', 'request_id': 'req-06577f87-cc40-4049-9c97-04c93777eae5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.485069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625cdea4b2e146798727e900b8b9d00b', 'request_id': 'req-06577f87-cc40-4049-9c97-04c93777eae5'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.502756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] The token cache is being invalidate because project 625cdea4b2e146798727e900b8b9d00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:42.503140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.503792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-06577f87-cc40-4049-9c97-04c93777eae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:42.505422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1003/2003] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:42 2022] DELETE /identity/v3/projects/625cdea4b2e146798727e900b8b9d00b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:42.506702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c489b8-fcf0-4621-8664-88b05ec60b0e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.507011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c489b8-fcf0-4621-8664-88b05ec60b0e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.507272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c489b8-fcf0-4621-8664-88b05ec60b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.525640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e8c489b8-fcf0-4621-8664-88b05ec60b0e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:42.526208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c8b0ba-5654-4f74-8f12-2f5b87fe4bbd admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.526907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e8c489b8-fcf0-4621-8664-88b05ec60b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.529894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.530552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.530866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.531143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.532948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.588928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1004/2004] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:42.588928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087314c9-8f37-4522-b58c-9fc33d749cbc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.588928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087314c9-8f37-4522-b58c-9fc33d749cbc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.588928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087314c9-8f37-4522-b58c-9fc33d749cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.601465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.602960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.607849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-087314c9-8f37-4522-b58c-9fc33d749cbc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:42.608972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-087314c9-8f37-4522-b58c-9fc33d749cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.612366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1001/2005] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:42.625664 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1005/2006] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:42.625764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.626622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.626933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.627209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.629179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.670039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:42.671055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:42.679496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1006/2007] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:42.684903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.694825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c56a1-7793-448c-a1c7-b50a1896fb3f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.699825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.700532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.700812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.701392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.702090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:42.702517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.704652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.718826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1007/2008] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:42.723252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.725013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143bef-db48-49f7-b88f-071e046a5f52 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.734845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.735516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.735798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.736150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.738511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947a10e-1062-440b-a27c-1d18084110e1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.747971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.748682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.748966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.749248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.750136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.753662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.755609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.755828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.781848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1002/2009] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:42.820925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1008/2010] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:42.822796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.835621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7777-7194-4f88-ae0e-07c437a49f60 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.921713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.922510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.923444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.923444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.924057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.926407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:42.955303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1003/2011] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:42 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:42.960972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:42.981281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2c1bd-114d-4913-b3fc-985f386516f1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:42.987325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:42.988124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:42.988558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:42.988946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:42.989856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:42.991947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.017924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1009/2012] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:43.018824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.032943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f458c-69bb-4167-8baf-67ebd4ab9988 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:43.040315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:43.042086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.042086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.042371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.043357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:43.045086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab49c7-33cb-4226-bab1-a074eb2b529e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.062688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1004/2013] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:05:43.066407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.082632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec19a5-dcaf-4164-99a6-0a6fdec81526 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:43.088511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:43.089758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.090189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.090364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] PATH_INFO: `/v3/projects/8e625f7fa5bb46e9ab6a4128278a4123/users/8d66e89f57c1413f8e37564ec002f150/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.107932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e625f7fa5bb46e9ab6a4128278a4123, user_id=8d66e89f57c1413f8e37564ec002f150, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:43.111066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.131623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1010/2014] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:43 2022] PUT /identity/v3/projects/8e625f7fa5bb46e9ab6a4128278a4123/users/8d66e89f57c1413f8e37564ec002f150/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:43.142726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.143124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.143461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.183537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] MFA Rules not processed for user `8d66e89f57c1413f8e37564ec002f150`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:43.184921 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:43.248542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1005/2015] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:43.259744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.261729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:43.329318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.330865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:43.332284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a90e5-8674-43e2-a94f-d66b08955673 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:43.336542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:43.337284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.337621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.338309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.347719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:43.350893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.370590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1011/2016] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:43.403940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1d3a2-62ef-4dd3-aedd-86204f331d86 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:43.408500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:43.409396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.409689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.409969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] PATH_INFO: `/v3/projects/08f75b7a96244e86bedd7ff753d622f9` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.411232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f75b7a96244e86bedd7ff753d622f9)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:43.413289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.459656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f75b7a96244e86bedd7ff753d622f9', 'request_id': 'req-044ac5a7-357a-467c-b81a-ee2c75e4796c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.465676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f75b7a96244e86bedd7ff753d622f9', 'request_id': 'req-044ac5a7-357a-467c-b81a-ee2c75e4796c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.472202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f75b7a96244e86bedd7ff753d622f9', 'request_id': 'req-044ac5a7-357a-467c-b81a-ee2c75e4796c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.488261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] The token cache is being invalidate because project 08f75b7a96244e86bedd7ff753d622f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:43.488699 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.489761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.491989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1006/2017] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:43 2022] DELETE /identity/v3/projects/08f75b7a96244e86bedd7ff753d622f9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:43.495852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.510440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065faa8b-8a40-4ada-9561-2c9927f0ba2a service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:43.573954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:43.575067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:43.575416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:43.575760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] PATH_INFO: `/v3/users/b676ca8c889e4ac080eb01caba09a3a8` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:43.577087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b676ca8c889e4ac080eb01caba09a3a8)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:43.579351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:43.631225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b676ca8c889e4ac080eb01caba09a3a8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.642302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b676ca8c889e4ac080eb01caba09a3a8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.664317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b676ca8c889e4ac080eb01caba09a3a8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.665197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b676ca8c889e4ac080eb01caba09a3a8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.665957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bf53f2a-2915-4155-b592-a7afceea0ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b676ca8c889e4ac080eb01caba09a3a8'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:43.682447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1012/2018] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:43 2022] DELETE /identity/v3/users/b676ca8c889e4ac080eb01caba09a3a8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:43.969046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:43.970666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:43.985049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ac5a7-357a-467c-b81a-ee2c75e4796c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.041415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.042318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.042590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.042910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] PATH_INFO: `/v3/projects/b9c92927633a4107a5051cfb0714f4f8` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.044106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c92927633a4107a5051cfb0714f4f8)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.046017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.093053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c92927633a4107a5051cfb0714f4f8', 'request_id': 'req-d642d20f-b189-40f0-a6d6-b8cb3b1be819'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:44.098972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c92927633a4107a5051cfb0714f4f8', 'request_id': 'req-d642d20f-b189-40f0-a6d6-b8cb3b1be819'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:44.105438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c92927633a4107a5051cfb0714f4f8', 'request_id': 'req-d642d20f-b189-40f0-a6d6-b8cb3b1be819'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:44.119928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] The token cache is being invalidate because project b9c92927633a4107a5051cfb0714f4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:44.120225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:44.120840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d642d20f-b189-40f0-a6d6-b8cb3b1be819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:44.122551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1007/2019] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:43 2022] DELETE /identity/v3/projects/b9c92927633a4107a5051cfb0714f4f8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:44.127648 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.128014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.128355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.149137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:44.150541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:44.213144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1013/2020] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:44.221975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.222263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.223157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.246427 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:44.247625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:44.255472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1008/2021] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:44.259752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.269311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1694fb-78bd-4396-96ae-1a63e206c123 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.274253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.274976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.275264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.275570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.276302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:44.276612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.278227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.289365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1014/2022] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:44.293972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.303944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efeb4c9-1f05-4568-af22-daf26393411a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.309130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.310061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.310347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.310627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.311379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.313457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.343440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1009/2023] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:44.347921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.357946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c331f5-49a8-49a9-acbd-41a0bb94a275 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.414145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.414866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.415148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.415425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.416159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.418102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.440310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1015/2024] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:44.444603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.454969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53673eed-46fa-4811-86e1-78f8cd90a7da admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.459811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.460470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.460754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.461029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.461753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.463522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.473738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1010/2025] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:44.478007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.488113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1862591-8004-44af-a19a-00d4d3a980a4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.493025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.493668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.493984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.494423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.495211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.496871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df87c7d-5e0a-4789-8007-8f6daf5a62fe admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.507171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1016/2026] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:44.511645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.522304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcf8-5e64-47ed-ab8a-fef7ac584430 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.528548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.529577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.529855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.530132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] PATH_INFO: `/v3/projects/ab0a4e4378254dfe8f987b9a97df4116/users/8194d34dd5624e1f9785ae1c3a642811/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.545537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0a4e4378254dfe8f987b9a97df4116, user_id=8194d34dd5624e1f9785ae1c3a642811, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.548406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.564293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1011/2027] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:44 2022] PUT /identity/v3/projects/ab0a4e4378254dfe8f987b9a97df4116/users/8194d34dd5624e1f9785ae1c3a642811/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:44.574833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.575161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.575434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.603829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] MFA Rules not processed for user `8194d34dd5624e1f9785ae1c3a642811`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:44.605031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:44.671059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1017/2028] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:44.675834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.740500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49090b2-9d85-438a-9252-9fa62339bf27 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.745793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.746471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.746788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.747135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.747793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.749751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.777275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1012/2029] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:44.781539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.792938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c5163-4044-4da2-8fa5-f1fd4a3db314 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.848502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.849183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.849541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.849819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.850507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.852494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.874328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1018/2030] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:44 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:44.878525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.888916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717c990-f12d-4722-820e-6cb4a2cc29d6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.893536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.894259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.894543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.894855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.895578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.897567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.908031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1013/2031] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:44.912205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.922971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016574-ecd5-4986-bddd-449f58863a99 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:44.928421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:44.929307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:44.929591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:44.929864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] PATH_INFO: `/v3/projects/87816c88daa2406296db973535dc1e0f/users/774873174a5e40ab8c11c58b7b6d77e7/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:44.945400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87816c88daa2406296db973535dc1e0f, user_id=774873174a5e40ab8c11c58b7b6d77e7, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:44.948148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:44.963460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1019/2032] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:44 2022] PUT /identity/v3/projects/87816c88daa2406296db973535dc1e0f/users/774873174a5e40ab8c11c58b7b6d77e7/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:44.968153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:44.978149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4a295-6230-4285-88cb-2f5fd598596f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:45.035431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:45.036126 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:45.036404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:45.036702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:45.037433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:45.039082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51737b31-12a1-4783-994c-e9e1f436239d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:45.048770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1014/2033] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:45.053102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:45.063484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac89bf2-a705-4313-8333-ce6c54ffc4a3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:45.068119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:45.069014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:45.069309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:45.069580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] PATH_INFO: `/v3/projects/87816c88daa2406296db973535dc1e0f/users/774873174a5e40ab8c11c58b7b6d77e7/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:45.071557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87816c88daa2406296db973535dc1e0f, user_id=774873174a5e40ab8c11c58b7b6d77e7, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:45.074212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:45.086549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1020/2034] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:45 2022] PUT /identity/v3/projects/87816c88daa2406296db973535dc1e0f/users/774873174a5e40ab8c11c58b7b6d77e7/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:45.097771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:45.098065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:45.098342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:45.126721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] MFA Rules not processed for user `774873174a5e40ab8c11c58b7b6d77e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:45.127929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:45.203453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1015/2035] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:45.217357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:45.219433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:45.280193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be401-ab0e-46db-a9e5-8cd5648d794a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:45.284440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:45.284982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:45.285310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:45.285589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:45.295785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:45.297237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:45.308967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1021/2036] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:45.394433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:45.407114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abec64-124d-4d09-be31-e6b4c85dbbe2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:45.410935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:45.411623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:45.411891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:45.412167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:45.475969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:45.477479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5af70-1ed1-48d4-b885-edb893181946 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:45.493907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1016/2037] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:46.015909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:46.017514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.084639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32f54-1714-4a0f-8349-28f0ad988993 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:46.090529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:46.091438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.091721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.092020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] PATH_INFO: `/v3/users/cab049852d074af28c85fc342b4523b1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.093383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab049852d074af28c85fc342b4523b1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:46.095397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:46.142687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab049852d074af28c85fc342b4523b1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.151961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab049852d074af28c85fc342b4523b1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.163972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab049852d074af28c85fc342b4523b1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.164676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab049852d074af28c85fc342b4523b1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.165440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab049852d074af28c85fc342b4523b1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.177699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1022/2038] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:46 2022] DELETE /identity/v3/users/cab049852d074af28c85fc342b4523b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:46.182330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.182616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.182919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.201715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:46.202973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.270095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1017/2039] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:46.280270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:46.281832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.342007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a71b6c-adac-4b04-8508-f6ba4fd183c1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:46.347783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:46.348729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.349052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.349449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.361506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:46.362965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c5d98-b72b-43f8-88a6-bdb06c182cb9 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:46.372779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1023/2040] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:46.688144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:46.689736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.706847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77828343-4850-4070-8309-e01f8bb2c82c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:46.713937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:46.715299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.715636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.716358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] PATH_INFO: `/v3/projects/b82a9990d0af48af801f87b1f762d9a9` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.718150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b82a9990d0af48af801f87b1f762d9a9)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:46.721650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:46.768385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b82a9990d0af48af801f87b1f762d9a9', 'request_id': 'req-a5bc95df-0771-414e-9e55-fc7256aa68f7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.774116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b82a9990d0af48af801f87b1f762d9a9', 'request_id': 'req-a5bc95df-0771-414e-9e55-fc7256aa68f7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.780454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b82a9990d0af48af801f87b1f762d9a9', 'request_id': 'req-a5bc95df-0771-414e-9e55-fc7256aa68f7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.795029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] The token cache is being invalidate because project b82a9990d0af48af801f87b1f762d9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:46.795541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.796162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a5bc95df-0771-414e-9e55-fc7256aa68f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:46.798170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1018/2041] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:46 2022] DELETE /identity/v3/projects/b82a9990d0af48af801f87b1f762d9a9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:46.802991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.803291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.803562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.822979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:46.824417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.887630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1024/2042] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:46.895329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.895593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.895865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.914869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:46.916187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:46.925661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1019/2043] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:46.930728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:46.940617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9fdf-97ca-4f02-a5da-7dc21c975fac None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:46.949876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:46.950628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.950954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.951273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.951944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:46.952282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:46.953905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:46.966343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1025/2044] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:46.970453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:46.981365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec1f30-d4ad-47ef-90da-3373a30a9f93 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:46.987882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:46.988644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:46.989000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:46.989341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:46.990106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:46.992388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.023817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1020/2045] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:46 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:47.028254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:47.039116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccc2d1-f83e-48bf-a7b6-2679ebf3c020 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:47.094210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:47.094937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.095221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.095497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.096200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:47.098117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.118427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1026/2046] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:47 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:47.122776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:47.133102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8195e6-873c-48da-b7c2-b0a9516db99a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:47.138156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:47.138850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.139137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.139408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.140136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:47.141735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.152822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1021/2047] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:47.158698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:47.169899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90a6f9-128f-4f17-a8af-b006ebb33b80 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:47.175525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:47.176185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.176463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.176744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.177487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:47.179115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce65dde-83fa-4cb8-8e29-3799c60f3216 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.189641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1027/2048] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:47.195202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:47.205852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777715b8-24bb-4f33-bd68-9ca4b228889f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:47.211503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:47.212403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.212675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.212958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] PATH_INFO: `/v3/projects/b94fa1d96ca84bbb80a52ff505f925d4/users/9aa407b3bbfe47f0acf108827d7cfa93/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.227995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94fa1d96ca84bbb80a52ff505f925d4, user_id=9aa407b3bbfe47f0acf108827d7cfa93, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:47.230913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.248979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1022/2049] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:47 2022] PUT /identity/v3/projects/b94fa1d96ca84bbb80a52ff505f925d4/users/9aa407b3bbfe47f0acf108827d7cfa93/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:47.256987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b696e1-66f1-49d9-b83c-c545190d9a25 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.257379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b696e1-66f1-49d9-b83c-c545190d9a25 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.257763 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b696e1-66f1-49d9-b83c-c545190d9a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.277635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c0b696e1-66f1-49d9-b83c-c545190d9a25 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:47.278955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c0b696e1-66f1-49d9-b83c-c545190d9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:47.341549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1028/2050] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:47.353278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:47.355344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:47.412701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f54ff-7a3a-4a4c-81f8-1dab75524b07 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:47.416874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:47.417519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:47.417802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:47.418104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:47.427340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:47.428777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:47.438660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1023/2051] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:05:48.139503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.139884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.140290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.167233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] MFA Rules not processed for user `9aa407b3bbfe47f0acf108827d7cfa93`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:48.168576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:48.233020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1029/2052] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:48.237704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.247346 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02ac-12b4-44de-827d-4ff424e5b0d2 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.252310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.252971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.253249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.253522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.254206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.256112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.284693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1024/2053] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:48 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:48.289176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.302351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf58ba-1f2c-4c76-9506-f7155645f179 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.360722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.361725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.362064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.362475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.363520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.366554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.390925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1030/2054] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:48 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:48.394962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.405831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d52fa-22e5-4b20-8c70-e0c445e06505 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.411711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.412395 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.412678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.412947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.413669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.415305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.425686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1025/2055] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:48.429814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.440309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49961b17-5eb6-4afd-833d-5b71161d9ff1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.446225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.447151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.447434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.447710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] PATH_INFO: `/v3/projects/f58c097cfdf144e8a66c055da9ed32d7/users/dd3a8c5e32d64619bbca692def36c06a/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.463407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58c097cfdf144e8a66c055da9ed32d7, user_id=dd3a8c5e32d64619bbca692def36c06a, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.466082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.480219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1031/2056] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:48 2022] PUT /identity/v3/projects/f58c097cfdf144e8a66c055da9ed32d7/users/dd3a8c5e32d64619bbca692def36c06a/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:48.484392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.494861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfe2c0-241f-496e-8769-a3cf1ce2ba96 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.549448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.550112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.550408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.550685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.551429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.553038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d11863-1155-49cf-890c-816e6b845619 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.562546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1026/2057] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:48.568867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:48.580181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb90e60-eb52-4f28-85ad-2122c83a2446 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:48.585960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:48.586893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:48.587172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:48.587443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] PATH_INFO: `/v3/projects/f58c097cfdf144e8a66c055da9ed32d7/users/dd3a8c5e32d64619bbca692def36c06a/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:48.589692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58c097cfdf144e8a66c055da9ed32d7, user_id=dd3a8c5e32d64619bbca692def36c06a, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:48.592390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:48.603162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1032/2058] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:48 2022] PUT /identity/v3/projects/f58c097cfdf144e8a66c055da9ed32d7/users/dd3a8c5e32d64619bbca692def36c06a/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:49.295445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:49.295990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:49.295990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:49.323487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] MFA Rules not processed for user `dd3a8c5e32d64619bbca692def36c06a`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:49.324826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:49.392052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1027/2059] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:50.459005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:50.523312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e9d6-9fbc-497b-bc95-688a0d7fb3ff admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:50.528373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:50.529284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:50.529564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:50.529838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] PATH_INFO: `/v3/users/9aa407b3bbfe47f0acf108827d7cfa93` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:50.531341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa407b3bbfe47f0acf108827d7cfa93)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:50.533524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:50.598871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa407b3bbfe47f0acf108827d7cfa93'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.608721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa407b3bbfe47f0acf108827d7cfa93'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.622116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa407b3bbfe47f0acf108827d7cfa93'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.622896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa407b3bbfe47f0acf108827d7cfa93'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.623628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa407b3bbfe47f0acf108827d7cfa93'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.635575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1033/2060] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:50 2022] DELETE /identity/v3/users/9aa407b3bbfe47f0acf108827d7cfa93 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:50.836532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:50.849261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e0f00-7941-4ac2-aaf6-161b0cf64aae None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:50.910037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:50.911049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:50.911367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:50.911613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] PATH_INFO: `/v3/projects/b94fa1d96ca84bbb80a52ff505f925d4` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:50.912850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94fa1d96ca84bbb80a52ff505f925d4)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:50.914800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:50.968993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94fa1d96ca84bbb80a52ff505f925d4', 'request_id': 'req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.978210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94fa1d96ca84bbb80a52ff505f925d4', 'request_id': 'req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:50.984783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94fa1d96ca84bbb80a52ff505f925d4', 'request_id': 'req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.000183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] The token cache is being invalidate because project b94fa1d96ca84bbb80a52ff505f925d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:51.000472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.001115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.002742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1028/2061] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:50 2022] DELETE /identity/v3/projects/b94fa1d96ca84bbb80a52ff505f925d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:05:51.006993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.008501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:51.022035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796bed0-0ce1-40cf-bc07-e7193529d027 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.079908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.080702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.080985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.081256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] PATH_INFO: `/v3/users/dd3a8c5e32d64619bbca692def36c06a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.082561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3a8c5e32d64619bbca692def36c06a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.084500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.135547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3a8c5e32d64619bbca692def36c06a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.144476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3a8c5e32d64619bbca692def36c06a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.159246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3a8c5e32d64619bbca692def36c06a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.159839 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3a8c5e32d64619bbca692def36c06a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.160470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f9fb6c76-aa0f-46c5-b514-3fce83b5f0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3a8c5e32d64619bbca692def36c06a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.173345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1034/2062] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:51 2022] DELETE /identity/v3/users/dd3a8c5e32d64619bbca692def36c06a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:51.353482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.355235 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:51.370198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a673b6-f921-4c03-a541-d8f0aeb74c9e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.430230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.431179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.431461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.431750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] PATH_INFO: `/v3/projects/f58c097cfdf144e8a66c055da9ed32d7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.432961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58c097cfdf144e8a66c055da9ed32d7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.435059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.483353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58c097cfdf144e8a66c055da9ed32d7', 'request_id': 'req-8854267c-7133-40f0-9675-561dbc11ae59'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.488983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58c097cfdf144e8a66c055da9ed32d7', 'request_id': 'req-8854267c-7133-40f0-9675-561dbc11ae59'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.495915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58c097cfdf144e8a66c055da9ed32d7', 'request_id': 'req-8854267c-7133-40f0-9675-561dbc11ae59'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.509628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] The token cache is being invalidate because project f58c097cfdf144e8a66c055da9ed32d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:51.509918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.510694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8854267c-7133-40f0-9675-561dbc11ae59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:51.512449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1029/2063] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:51 2022] DELETE /identity/v3/projects/f58c097cfdf144e8a66c055da9ed32d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:51.517539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.518017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.518119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.536387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:51.537587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:51.596481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1035/2064] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:51.607676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.607991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.608264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.628112 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:51.629345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:51.639037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1030/2065] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:51.643673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.654539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385fac7-633d-4487-98ee-642205f69dd2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.659656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.660324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.660600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.660873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.661612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:51.661921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.663687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.676143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1036/2066] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:51.680767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.690397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e62be2-3c53-4476-9bf8-2182e247bf1c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.696028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.696683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.696965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.697237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.697929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.699937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.726737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1031/2067] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:51 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:51.731026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.741209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c140-88ed-4c66-9bbf-54d9ba4fecd4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.798947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.800016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.800414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.800862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.801977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.805236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.833802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1037/2068] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:51 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:51.838195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.852980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151be8e3-cc28-4479-8575-5bf10b8bf372 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.860052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.860721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.861004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.861280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.862007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.863768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.874752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1032/2069] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:51.879130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.889527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e51a8-43af-4a0f-9a93-2e1ff06609d6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.895161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.895852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.896107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.896381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.897477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.899107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edddd5b-a887-4e28-bead-2436fee9a11d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.909429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1038/2070] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:51.915601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:51.931227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6841b-470b-4592-a041-edaa912b9c00 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:51.937266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:51.938158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.938450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.938750 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] PATH_INFO: `/v3/projects/1a060174702c402e90ccabb20e462255/users/0e5eb834c6c245b58f32b1ca536f8b37/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:51.953146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a060174702c402e90ccabb20e462255, user_id=0e5eb834c6c245b58f32b1ca536f8b37, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:51.955942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:51.971669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1033/2071] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:51 2022] PUT /identity/v3/projects/1a060174702c402e90ccabb20e462255/users/0e5eb834c6c245b58f32b1ca536f8b37/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:51.982183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:51.982473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:51.982781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.009623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] MFA Rules not processed for user `0e5eb834c6c245b58f32b1ca536f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:52.010849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:52.075145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1039/2072] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:52.079892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.142845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e493b6-abbd-449d-9f2a-f6b7315bc070 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.149250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.149923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.150237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.150507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.151252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.153281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.184004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1034/2073] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:52 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:52.188279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.200281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf8812-ca09-4219-8dd9-1273195ef6fa None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.263599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.264447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.264824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.265228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.266145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.268207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.293247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1040/2074] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:52 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:52.294560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.305279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5e37c-06a1-4854-be64-0b1997cf3eec admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.310073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.310772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.311057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.311331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.312194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.313805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.326700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1035/2075] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:52.328346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.338276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ddc7-b23b-4663-be42-9d6d7fb1b29c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.343416 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.344488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.344742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.345029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] PATH_INFO: `/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7/users/81f03bcb383f4796a62cd0064e19d505/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.361748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676ef4308d84d0c80ad259d6f3c3aa7, user_id=81f03bcb383f4796a62cd0064e19d505, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.364765 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.381749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1041/2076] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:52 2022] PUT /identity/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7/users/81f03bcb383f4796a62cd0064e19d505/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:52.386152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.398165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecf128-81a9-452b-af84-50f41e903fe6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.457971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.458672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.458957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.459230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.459967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.461561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbe333-69b6-4343-861d-7241e3b348fd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.473803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1036/2077] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:52.478265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.488701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796bbc03-ac4a-4787-a159-574ca71c3763 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.499366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.503518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.503518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.503518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] PATH_INFO: `/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7/users/81f03bcb383f4796a62cd0064e19d505/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.504295 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2676ef4308d84d0c80ad259d6f3c3aa7, user_id=81f03bcb383f4796a62cd0064e19d505, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.507795 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.519479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1042/2078] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:52 2022] PUT /identity/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7/users/81f03bcb383f4796a62cd0064e19d505/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:52.535417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.535742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.536023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.565795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] MFA Rules not processed for user `81f03bcb383f4796a62cd0064e19d505`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:52.567052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:52.638348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1037/2079] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:52.650175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:52.651948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:52.707380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93369c9c-4e5c-4e94-b2ad-d683f1c118af admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:52.711406 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:52.712095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:52.712377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:52.712654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:52.722400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:52.723939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09b33-57a0-4689-a3cf-ffbeec2d8b86 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:52.733363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1043/2080] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:54.114513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:54.179354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48b90-b3ff-41d4-8587-149860d81a99 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:54.184358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:54.185223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:54.185496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:54.185762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] PATH_INFO: `/v3/users/0e5eb834c6c245b58f32b1ca536f8b37` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:54.187013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5eb834c6c245b58f32b1ca536f8b37)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:54.188939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:54.237429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5eb834c6c245b58f32b1ca536f8b37'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.238101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5eb834c6c245b58f32b1ca536f8b37'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.246295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5eb834c6c245b58f32b1ca536f8b37'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.258846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5eb834c6c245b58f32b1ca536f8b37'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.265734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5eb834c6c245b58f32b1ca536f8b37'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.272423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1038/2081] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:54 2022] DELETE /identity/v3/users/0e5eb834c6c245b58f32b1ca536f8b37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:54.279026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:54.279875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:54.280190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:54.300247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:54.301511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:54.368819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1044/2082] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:54.378917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:54.380447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:54.438314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d55cc-5223-4e96-b51a-1a4d234b63c8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:54.442079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:54.442770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:54.443063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:54.443335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:54.452561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:54.454033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:54.463999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1039/2083] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:05:54.737944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:54.739536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:54.752583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898126-e8cb-4af4-b583-1102c4163cbd None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:54.757228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:54.758097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:54.758388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:54.758688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] PATH_INFO: `/v3/projects/1a060174702c402e90ccabb20e462255` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:54.759874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a060174702c402e90ccabb20e462255)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:54.761913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:54.812286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a060174702c402e90ccabb20e462255', 'request_id': 'req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.815117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a060174702c402e90ccabb20e462255', 'request_id': 'req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.821566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a060174702c402e90ccabb20e462255', 'request_id': 'req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.835397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] The token cache is being invalidate because project 1a060174702c402e90ccabb20e462255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:54.835689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.836344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.841121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1045/2084] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:54 2022] DELETE /identity/v3/projects/1a060174702c402e90ccabb20e462255 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:54.842254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:54.851733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509199d7-bb4d-4605-b956-979631081e9a service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:54.920974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:54.920974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:54.920974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:54.920974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] PATH_INFO: `/v3/users/81f03bcb383f4796a62cd0064e19d505` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:54.923561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f03bcb383f4796a62cd0064e19d505)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:54.925596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:54.989046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f03bcb383f4796a62cd0064e19d505'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.989698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f03bcb383f4796a62cd0064e19d505'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:54.999027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f03bcb383f4796a62cd0064e19d505'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.014682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f03bcb383f4796a62cd0064e19d505'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.022470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-65d2504a-80da-4d73-b592-f492a8cd8207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f03bcb383f4796a62cd0064e19d505'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.029546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1040/2085] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:05:54 2022] DELETE /identity/v3/users/81f03bcb383f4796a62cd0064e19d505 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:55.307320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.308729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:55.323101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff51502-d71e-4f88-a759-1b07d5ec5ce3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.393257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.394125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.394408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.394714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] PATH_INFO: `/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.395888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2676ef4308d84d0c80ad259d6f3c3aa7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.398147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.445814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2676ef4308d84d0c80ad259d6f3c3aa7', 'request_id': 'req-8e337c2e-b13b-4a13-ab1f-e164891418b4'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.451050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2676ef4308d84d0c80ad259d6f3c3aa7', 'request_id': 'req-8e337c2e-b13b-4a13-ab1f-e164891418b4'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.457098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2676ef4308d84d0c80ad259d6f3c3aa7', 'request_id': 'req-8e337c2e-b13b-4a13-ab1f-e164891418b4'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.482853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] The token cache is being invalidate because project 2676ef4308d84d0c80ad259d6f3c3aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:05:55.483258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.483981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8e337c2e-b13b-4a13-ab1f-e164891418b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:05:55.485647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1046/2086] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:05:55 2022] DELETE /identity/v3/projects/2676ef4308d84d0c80ad259d6f3c3aa7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:55.490632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.491143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.491334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.510473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:55.512059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:55.571362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1041/2087] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:55.579132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.579425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.579707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.597669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:55.598947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:55.607276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1047/2088] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:55.611889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.621824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3d5e7-045a-4df4-ba1e-8b6480e5f0f9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.626490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.627277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.627951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.628269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.629110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:05:55.629446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.631199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.647911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1042/2089] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:05:55.649525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.661334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a752e-527c-49fd-b234-8733a785d44e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.672513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.673211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.673658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.674292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.675226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.677589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.717625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1048/2090] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:55 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:55.722165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.732533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5524-33d3-460a-b44f-741cc0c9af2b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.787347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.788029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.788313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.788586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.789265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.791255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.811653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1043/2091] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:55 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:55.815815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.825927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fda82-ae07-4f0e-bc6f-d9a898dc46a1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.830690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.831351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.831619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.831891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.832603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.834241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.844410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1049/2092] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:55.848424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.858080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467921c0-c269-4ab8-bdb5-614e8667123a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.862909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.863564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.863847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.864123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.864860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.866438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f2f57-db9e-4cc1-af85-20f8909c2bae admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.876625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1044/2093] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:55.880599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:55.902173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084051a0-cc25-4db7-86ff-6f6863ecf962 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:55.907637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:55.908525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.908806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.909079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] PATH_INFO: `/v3/projects/92bec29125d145bcbb8cdbed554dd0db/users/7e6a68e34ca145ecb76ebf35e2df9d19/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.925013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bec29125d145bcbb8cdbed554dd0db, user_id=7e6a68e34ca145ecb76ebf35e2df9d19, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:55.927704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:55.942492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1050/2094] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:55 2022] PUT /identity/v3/projects/92bec29125d145bcbb8cdbed554dd0db/users/7e6a68e34ca145ecb76ebf35e2df9d19/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:55.956912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:55.957207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:55.957483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:55.986786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] MFA Rules not processed for user `7e6a68e34ca145ecb76ebf35e2df9d19`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:55.988651 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:56.055135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1045/2095] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:56.059535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.125315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a64566-7a4a-44c1-952f-bb05575e9845 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.130369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.131262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.131546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.131819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.132625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.134681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.170135 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1051/2096] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:56.171219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.183957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed792ae-382b-45f6-80f2-b25374533b9d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.243257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.244015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.244365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.244819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.245613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.247708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.269665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1046/2097] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:05:56.273023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.283585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c93ff-7301-40a3-a22a-c0886ba183f2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.289174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.289841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.290126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.290439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.291208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.292848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.303180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1052/2098] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:56.307481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.317580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454dca71-98d4-4697-a8ba-7db2ba4c2e09 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.322261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.322976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.323270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.323547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.324357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.325952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fc8b8-885b-4cc5-896a-1409274ef001 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.335893 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1047/2099] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:56.340177 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.350166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab6e1a-d956-4f21-bd04-a18d1e18d11d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.354640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.355580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.355969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.356249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] PATH_INFO: `/v3/projects/c71fe6ed832949aaa9eaab89690ead2d/users/39607c3197c74bcdaa2aa540f89c6c6f/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.370138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71fe6ed832949aaa9eaab89690ead2d, user_id=39607c3197c74bcdaa2aa540f89c6c6f, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.372840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.389277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1053/2100] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:56 2022] PUT /identity/v3/projects/c71fe6ed832949aaa9eaab89690ead2d/users/39607c3197c74bcdaa2aa540f89c6c6f/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:56.400321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.400609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.400883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.427771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] MFA Rules not processed for user `39607c3197c74bcdaa2aa540f89c6c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:56.428972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:56.491722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1048/2101] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:05:56.496252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.557557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54639c-3a58-48c4-a8e2-d4d7b1d33fc3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.562668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.563352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.563638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.563917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.564609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.566575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.595833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1054/2102] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:56.600038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.611356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f1564-5851-421b-9cd4-bde0aef12722 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.669498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.670185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.670469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.670783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.671505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.673465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.696277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1049/2103] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:05:56.700563 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.711596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b586731-9c00-4803-a8c8-448daeb1313d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.717315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.718147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.718505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.718909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.719724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.721693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.733457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1055/2104] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:56.737720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.748370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af20ef-ec92-4208-852f-cc928cc9f0a4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.754709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.755692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.756054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.756331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] PATH_INFO: `/v3/projects/840eae3f0dae4460bde17738bb39615f/users/4f0a59c04e4b4a0886ac34e3b254d951/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.773134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] RBAC: Authorizing `identity:create_grant(project_id=840eae3f0dae4460bde17738bb39615f, user_id=4f0a59c04e4b4a0886ac34e3b254d951, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.775842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.790836 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1050/2105] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:56 2022] PUT /identity/v3/projects/840eae3f0dae4460bde17738bb39615f/users/4f0a59c04e4b4a0886ac34e3b254d951/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:56.795056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.805594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303a241-b110-42db-b2a1-ef0151eaa77b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.862522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.863245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.863531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.863805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.865260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.866538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d69a12-1fa8-4621-8e9b-e1344a6a1952 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.876413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1056/2106] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:05:56.880637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:56.890929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490773-066a-4f51-8401-9d95f2a1067d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:56.895659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:56.896868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.897149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.897424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] PATH_INFO: `/v3/projects/840eae3f0dae4460bde17738bb39615f/users/4f0a59c04e4b4a0886ac34e3b254d951/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.899490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] RBAC: Authorizing `identity:create_grant(project_id=840eae3f0dae4460bde17738bb39615f, user_id=4f0a59c04e4b4a0886ac34e3b254d951, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:56.902143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:56.912614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1051/2107] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:05:56 2022] PUT /identity/v3/projects/840eae3f0dae4460bde17738bb39615f/users/4f0a59c04e4b4a0886ac34e3b254d951/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:05:56.923227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:56.923650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:56.923985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:56.950350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] MFA Rules not processed for user `4f0a59c04e4b4a0886ac34e3b254d951`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:05:56.951585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:57.021754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1057/2108] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:05:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:05:57.033494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:57.035456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:05:57.092308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6409f-e55c-4ef5-a15d-b8fa61c1112d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:57.095986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:57.096646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:57.096934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:57.097213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:57.106403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:57.107915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:57.117214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1052/2109] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:05:57.623161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:05:57.634688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809081-45c1-4a8e-9800-b7cf737a2d1f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:05:57.639633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:05:57.640284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:05:57.640569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:05:57.640819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:05:57.709521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:05:57.711077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fd5f6-bb7f-40eb-9d6a-1d211f621164 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:05:57.720658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1058/2110] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:05:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:05.455847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:05.457273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:05.545288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9650a4-9da0-4fb3-b2f4-09d51be9bc90 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:05.552352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:05.552981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:05.553333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:05.553561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] PATH_INFO: `/v3/users/8d66e89f57c1413f8e37564ec002f150` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:05.555259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d66e89f57c1413f8e37564ec002f150)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:05.557838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:05.612253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d66e89f57c1413f8e37564ec002f150'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:05.613155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d66e89f57c1413f8e37564ec002f150'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:05.621249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d66e89f57c1413f8e37564ec002f150'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:05.632957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d66e89f57c1413f8e37564ec002f150'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:05.639856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d66e89f57c1413f8e37564ec002f150'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:05.646633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1053/2111] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:05 2022] DELETE /identity/v3/users/8d66e89f57c1413f8e37564ec002f150 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:05.650990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:05.651452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:05.651542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:05.668812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:05.669950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:05.727403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1059/2112] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:05.737534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:05.739036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:05.793745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4cadc-7c5b-40d6-829f-e319cee5e4f3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:05.797638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:05.798279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:05.798557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:05.798866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:05.808203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:05.809658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1d785-c472-45a7-8d9d-afc00e62efc7 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:05.819271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1054/2113] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:06.089316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.090798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:06.103422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4b3b-5eb0-4c8f-93f6-b871e72a3d9c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.108812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.110097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.110097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.110334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] PATH_INFO: `/v3/projects/8e625f7fa5bb46e9ab6a4128278a4123` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.111761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e625f7fa5bb46e9ab6a4128278a4123)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.113694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.160478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e625f7fa5bb46e9ab6a4128278a4123', 'request_id': 'req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:06.165786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e625f7fa5bb46e9ab6a4128278a4123', 'request_id': 'req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:06.171945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e625f7fa5bb46e9ab6a4128278a4123', 'request_id': 'req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:06.187463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] The token cache is being invalidate because project 8e625f7fa5bb46e9ab6a4128278a4123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:06.187745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:06.188392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4faa2ac5-8ea8-466d-8dd9-fc83d55d4458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:06.190016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1060/2114] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:06 2022] DELETE /identity/v3/projects/8e625f7fa5bb46e9ab6a4128278a4123 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:06.195330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.195627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.195913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.214584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:06.215815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:06.274296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1055/2115] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:06.283394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.283690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.283965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.304662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:06.305875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:06.315574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1061/2116] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:06.321995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.336802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce50b-67fb-40f6-871d-ab89f7342148 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.344850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.345507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.345790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.346058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.346816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:06.347129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.348722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.360337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1056/2117] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:06.364621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.374968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f32b8d-d482-4fc6-952c-2db853fe8aeb None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.380389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.381028 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.381312 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.381585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.382381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.384334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.413545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1062/2118] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:06 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:06.418012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.428341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a097afb-0a79-44fd-8be7-70eefa47afae admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.484221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.484904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.485187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.485465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.486193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.488156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.509748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1057/2119] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:06 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:06.513920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.524756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e290e5c-7648-4179-92f1-d3e1670c3587 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.529479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.530167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.530476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.530783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.531511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.533103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.543602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1063/2120] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:06.547756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.557867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebbb2c-da26-4a0e-8235-241c0834d783 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.563638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.564287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.564568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.564839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.565560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.567209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971c635-30d1-41ca-9e33-3b71e0805700 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.577188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1058/2121] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:06:06.581341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.592378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561887f-baff-4bda-ab40-e27feb41d89b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.598307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.599274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.599560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.599865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] PATH_INFO: `/v3/projects/47d184624c1d4bae9384dc4be14343fd/users/b687f70831024cac87826377235bd5a6/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.615556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d184624c1d4bae9384dc4be14343fd, user_id=b687f70831024cac87826377235bd5a6, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.618198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.634704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1064/2122] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:06 2022] PUT /identity/v3/projects/47d184624c1d4bae9384dc4be14343fd/users/b687f70831024cac87826377235bd5a6/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:06.640090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8de5d-ea28-4d84-a9d6-f02e8fd888bf None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.640392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8de5d-ea28-4d84-a9d6-f02e8fd888bf None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.640669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8de5d-ea28-4d84-a9d6-f02e8fd888bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.659759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4fa8de5d-ea28-4d84-a9d6-f02e8fd888bf None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:06.660962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4fa8de5d-ea28-4d84-a9d6-f02e8fd888bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:06.720586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1059/2123] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:06.730982 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:06.733408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:06.789845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34048f4-57f0-4bfd-a558-70cc1d023e40 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:06.793629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:06.794280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:06.794559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:06.794935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:06.804150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:06.805576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:06.815267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1065/2124] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:07.510001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019724-b73a-47a3-9941-a1fc00d23753 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:07.510575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019724-b73a-47a3-9941-a1fc00d23753 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:07.510575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d019724-b73a-47a3-9941-a1fc00d23753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:07.544811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9d019724-b73a-47a3-9941-a1fc00d23753 None None] MFA Rules not processed for user `b687f70831024cac87826377235bd5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:07.547103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9d019724-b73a-47a3-9941-a1fc00d23753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:07.623096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1060/2125] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:07.633647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:07.635225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:07.692321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bdfe-6b0c-4dff-87dc-d5b10b33298f service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:07.696230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:07.696892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:07.697174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:07.697442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:07.706049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:07.707584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:07.716453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1066/2126] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:10.117537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091be4e-d471-4ad0-a1b6-852de81f0917 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:10.118060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091be4e-d471-4ad0-a1b6-852de81f0917 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:10.118278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091be4e-d471-4ad0-a1b6-852de81f0917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:10.136839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b091be4e-d471-4ad0-a1b6-852de81f0917 None None] MFA Rules not processed for user `b687f70831024cac87826377235bd5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:10.137996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b091be4e-d471-4ad0-a1b6-852de81f0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:10.145093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1061/2127] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:11.924901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:11.926491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:11.944346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eba90-8480-4738-87b7-627926fd1844 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:11.950183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:11.951121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:11.951457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:11.951727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] PATH_INFO: `/v3/users/3303398e0bdd49ceb5d0fb53775b7efc` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:11.953150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3303398e0bdd49ceb5d0fb53775b7efc)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:11.955145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:12.004918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3303398e0bdd49ceb5d0fb53775b7efc'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.013590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3303398e0bdd49ceb5d0fb53775b7efc'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.026838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3303398e0bdd49ceb5d0fb53775b7efc'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.027636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3303398e0bdd49ceb5d0fb53775b7efc'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.028336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3303398e0bdd49ceb5d0fb53775b7efc'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.041799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1067/2128] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:11 2022] DELETE /identity/v3/users/3303398e0bdd49ceb5d0fb53775b7efc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:12.046733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.047252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.047356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.065351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:12.066612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.125661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1062/2129] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:12.136134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:12.137553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.217512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dc1d1-c3e4-46bd-94f0-da9b5b9575e8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:12.223165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:12.224184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.224637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.224931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.236449 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:12.239979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:12.258337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1068/2130] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:12.347885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:12.350959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.456003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160d5a3-f502-4d8c-b7fd-95c5810a14a1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:12.461665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:12.462425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.462779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.463067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.465102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.529991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:12.531547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5fba5-efa1-48e1-b467-e9373b0cbb0d service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:12.540990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1063/2131] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:12.641566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:12.643062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.659171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b4ea5-5b82-430e-80d5-be8c39268d68 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:12.663606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:12.664478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.664861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.665027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] PATH_INFO: `/v3/projects/120836c9ed9d4e8082451071e35c7cd1` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.666219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] RBAC: Authorizing `identity:delete_project(project_id=120836c9ed9d4e8082451071e35c7cd1)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:12.668447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:12.737075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120836c9ed9d4e8082451071e35c7cd1', 'request_id': 'req-77cb6a40-bc27-4979-9cb7-7b396e35914e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.742234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120836c9ed9d4e8082451071e35c7cd1', 'request_id': 'req-77cb6a40-bc27-4979-9cb7-7b396e35914e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.754282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120836c9ed9d4e8082451071e35c7cd1', 'request_id': 'req-77cb6a40-bc27-4979-9cb7-7b396e35914e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.778619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] The token cache is being invalidate because project 120836c9ed9d4e8082451071e35c7cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:12.778941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.779592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-77cb6a40-bc27-4979-9cb7-7b396e35914e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:12.781182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1069/2132] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:12 2022] DELETE /identity/v3/projects/120836c9ed9d4e8082451071e35c7cd1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:12.786686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.787006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.787385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.809134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:12.810769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.882715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1064/2133] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:12.890928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.891246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.891526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.910440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:12.911688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:12.919541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1070/2134] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:12.923843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:12.933808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf545-d7d3-4d31-9132-113767a2a51a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:12.939064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:12.939726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.940007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.940280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.941016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:12.941321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:12.942949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:12.954605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1065/2135] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:12.958719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:12.967924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b7083-5461-419c-b099-b5ef03f57379 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:12.973052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:12.973700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:12.973981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:12.974257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:12.974978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:12.976884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.003496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1071/2136] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:12 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:06:13.007768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:13.017586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770b6ae-d6b5-4c46-a739-925a559dfa1c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:13.070691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:13.071334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.071578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.071855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.072610 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:13.074584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.095901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1066/2137] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:13 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:13.100117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:13.110770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e8be6-54a0-4d03-a351-f0a8472b0784 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:13.115479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:13.116156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.116435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.116709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.117424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:13.119080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.130417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1072/2138] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:13.134568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:13.144736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e3f7f-1ed6-484f-af76-df682d0cf98d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:13.149920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:13.150583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.150917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.151193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.151922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:13.153546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a52a9e-bd11-4e28-8e6d-cb3ca88bee8c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.163896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1067/2139] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:13.169256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:13.179768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70745-b3ed-416d-b65a-5d3b2dde9831 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:13.184726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:13.185608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.185893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.186172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] PATH_INFO: `/v3/projects/3dc1f10cbf10469d8abe0641ae154834/users/7e73b5e40fca4a40b235f934b7573f22/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.201895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc1f10cbf10469d8abe0641ae154834, user_id=7e73b5e40fca4a40b235f934b7573f22, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:13.204831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.220542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1073/2140] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:13 2022] PUT /identity/v3/projects/3dc1f10cbf10469d8abe0641ae154834/users/7e73b5e40fca4a40b235f934b7573f22/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:13.225788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.226081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.226357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.244673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:13.245873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:13.307894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1068/2141] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:13.318989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:13.320894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:13.378042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b40f8-0a2d-4cca-85f0-52b1e71040da admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:13.382364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:13.383057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:13.383344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:13.383627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:13.393578 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:13.395092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883dc8f-0140-4733-bb68-b3fac144058a service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:13.405395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1074/2142] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:06:17.337968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:17.340556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:17.430484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a272f-a091-4c9c-87d3-0706e528ee8e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:17.438224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:17.439816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:17.440125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:17.440441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] PATH_INFO: `/v3/users/8194d34dd5624e1f9785ae1c3a642811` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:17.442066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8194d34dd5624e1f9785ae1c3a642811)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:17.444436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:17.507397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8194d34dd5624e1f9785ae1c3a642811'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:17.508301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8194d34dd5624e1f9785ae1c3a642811'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:17.516703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8194d34dd5624e1f9785ae1c3a642811'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:17.531274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8194d34dd5624e1f9785ae1c3a642811'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:17.539394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8194d34dd5624e1f9785ae1c3a642811'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:17.549331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1069/2143] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:17 2022] DELETE /identity/v3/users/8194d34dd5624e1f9785ae1c3a642811 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:17.553800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:17.554330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:17.554415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:17.588266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:17.589499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:17.694215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1075/2144] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:17.708294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:17.710919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:17.924379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cedb16-0c53-46c7-a131-50309a364219 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:17.929264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:17.930062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:17.930442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:17.931404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:17.943356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:17.945023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:17.958457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1070/2145] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:18.826126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:18.837507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:18.880670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:18.882787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:18.885331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ea58-f52f-4ecf-8866-ff6065196ec3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:18.892814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:18.894071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:18.896686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:18.897353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] PATH_INFO: `/v3/users/7e6a68e34ca145ecb76ebf35e2df9d19` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:18.901543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6a68e34ca145ecb76ebf35e2df9d19)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:18.906679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:18.907201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbef72-81c0-4c8d-8d1d-a5493e8e68de service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:18.924369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:18.925490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:18.925918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:18.926499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] PATH_INFO: `/v3/projects/ab0a4e4378254dfe8f987b9a97df4116` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:18.929057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0a4e4378254dfe8f987b9a97df4116)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:18.934841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:19.068507 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6a68e34ca145ecb76ebf35e2df9d19'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.085454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0a4e4378254dfe8f987b9a97df4116', 'request_id': 'req-5f601d19-6b91-437d-a20a-837fea95d5c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.091701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6a68e34ca145ecb76ebf35e2df9d19'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.101015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0a4e4378254dfe8f987b9a97df4116', 'request_id': 'req-5f601d19-6b91-437d-a20a-837fea95d5c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.120004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0a4e4378254dfe8f987b9a97df4116', 'request_id': 'req-5f601d19-6b91-437d-a20a-837fea95d5c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.138724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6a68e34ca145ecb76ebf35e2df9d19'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.141289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6a68e34ca145ecb76ebf35e2df9d19'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.144474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1ef938d9-0561-4142-9f43-e345d5d59672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6a68e34ca145ecb76ebf35e2df9d19'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.156622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] The token cache is being invalidate because project ab0a4e4378254dfe8f987b9a97df4116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:19.156919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.157742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.159829 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1071/2146] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:18 2022] DELETE /identity/v3/projects/ab0a4e4378254dfe8f987b9a97df4116 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:19.163590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:19.165479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:19.167883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1076/2147] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:18 2022] DELETE /identity/v3/users/7e6a68e34ca145ecb76ebf35e2df9d19 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:19.174342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:19.174884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:19.177116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:19.212550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:19.216155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:19.255147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f601d19-6b91-437d-a20a-837fea95d5c7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:19.354287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1077/2148] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:19.388526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:19.389860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:19.393845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:19.394183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] PATH_INFO: `/v3/users/774873174a5e40ab8c11c58b7b6d77e7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:19.395879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=774873174a5e40ab8c11c58b7b6d77e7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:19.399674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:19.417316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:19.419038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:19.470164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774873174a5e40ab8c11c58b7b6d77e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.470907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774873174a5e40ab8c11c58b7b6d77e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.482515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774873174a5e40ab8c11c58b7b6d77e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.500775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774873174a5e40ab8c11c58b7b6d77e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.501052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcab46-50bb-48c6-a6ef-08e24f5ffd61 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:19.506489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:19.507529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:19.507973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:19.508408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:19.512899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1b7ed70e-2112-4cdc-9e6c-bffe7e2c1f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774873174a5e40ab8c11c58b7b6d77e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:19.519707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:19.521967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:19.525844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1072/2149] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:19 2022] DELETE /identity/v3/users/774873174a5e40ab8c11c58b7b6d77e7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:19.537813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1078/2150] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:20.286234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:20.287542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:20.288020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:20.322874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] MFA Rules not processed for user `7e73b5e40fca4a40b235f934b7573f22`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:20.327110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.445850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1073/2151] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:20.451250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:20.454618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.483061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc919-35f3-40e3-b552-489dddb82d55 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:20.542528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:20.544816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.588483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:20.589228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:20.589518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:20.589938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:20.590783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:20.592598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:20.636334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1079/2152] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:20 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:20.642093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:20.647758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.665852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa92072-d9df-497c-958c-1280af27c451 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:20.755848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:20.757907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:20.758670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:20.759166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] PATH_INFO: `/v3/projects/92bec29125d145bcbb8cdbed554dd0db` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:20.761809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bec29125d145bcbb8cdbed554dd0db)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:20.764186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:20.764747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46191e84-dad0-439f-9afd-80306a225441 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:20.779443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:20.780175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:20.780464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:20.780775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:20.783861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:20.789682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:20.821187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bec29125d145bcbb8cdbed554dd0db', 'request_id': 'req-cb8d3157-7241-4517-bd14-0b032114ec2c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:20.830700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bec29125d145bcbb8cdbed554dd0db', 'request_id': 'req-cb8d3157-7241-4517-bd14-0b032114ec2c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:20.835518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1080/2153] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:20 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:20.836461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:20.843047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.844239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bec29125d145bcbb8cdbed554dd0db', 'request_id': 'req-cb8d3157-7241-4517-bd14-0b032114ec2c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:20.867919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] The token cache is being invalidate because project 92bec29125d145bcbb8cdbed554dd0db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:20.868631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:20.869425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:20.870561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aba375-37fb-4bc7-907b-24a0610c2dac admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:20.871672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1074/2154] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:20 2022] DELETE /identity/v3/projects/92bec29125d145bcbb8cdbed554dd0db => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:20.872878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:20.876116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:20.994544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d3157-7241-4517-bd14-0b032114ec2c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.000221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.001036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.001419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.001785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.003281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.005722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.022868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1075/2155] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:21.023863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.030132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.044755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8eda0c-2a48-46ba-a5a7-e8684f3b6a05 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.050991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.051885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.052172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.052460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] PATH_INFO: `/v3/users/39607c3197c74bcdaa2aa540f89c6c6f` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.053892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=39607c3197c74bcdaa2aa540f89c6c6f)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.055932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.110389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39607c3197c74bcdaa2aa540f89c6c6f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.111099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39607c3197c74bcdaa2aa540f89c6c6f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.117913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.119195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.119535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.119945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] PATH_INFO: `/v3/projects/87816c88daa2406296db973535dc1e0f` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.121278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87816c88daa2406296db973535dc1e0f)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.121417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39607c3197c74bcdaa2aa540f89c6c6f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.123264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.133414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39607c3197c74bcdaa2aa540f89c6c6f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.140674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39607c3197c74bcdaa2aa540f89c6c6f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.148119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1076/2156] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:21 2022] DELETE /identity/v3/users/39607c3197c74bcdaa2aa540f89c6c6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:21.151429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.151429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.207567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87816c88daa2406296db973535dc1e0f', 'request_id': 'req-d1c6105f-1668-4140-ac25-de58a4b67a5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.219971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87816c88daa2406296db973535dc1e0f', 'request_id': 'req-d1c6105f-1668-4140-ac25-de58a4b67a5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.235976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87816c88daa2406296db973535dc1e0f', 'request_id': 'req-d1c6105f-1668-4140-ac25-de58a4b67a5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.248496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d655a4-6cc0-430e-bc9c-36013d493efb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.260018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] The token cache is being invalidate because project 87816c88daa2406296db973535dc1e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:21.260375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.261092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-d1c6105f-1668-4140-ac25-de58a4b67a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.263327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1081/2157] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:20 2022] DELETE /identity/v3/projects/87816c88daa2406296db973535dc1e0f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:21.264736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.265040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.265365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.289672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] MFA Rules not processed for user `3ca94cdcf3824f56a886b757e41602dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:21.290880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.355970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.356898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.357184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.357512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] PATH_INFO: `/v3/projects/0a77e47eee1d494b98efc955d69e3299/users/552dc2cdabb647d795ec3033af3f1843/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.373412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a77e47eee1d494b98efc955d69e3299, user_id=552dc2cdabb647d795ec3033af3f1843, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.376662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db257a-9457-4500-a658-90e188175df4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.394668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1077/2158] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:21 2022] PUT /identity/v3/projects/0a77e47eee1d494b98efc955d69e3299/users/552dc2cdabb647d795ec3033af3f1843/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:21.395784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.396408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.396685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.407255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1082/2159] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:21.408567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.424481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.445915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043176-1ed9-4e43-93e1-90a3680b4ebb None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.448115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:21.449359 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.524343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.525110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.526138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.526600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.528523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.530595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.544963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1083/2160] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:21.549808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.561033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b7d3-1c32-424b-bd24-75c2f80ce46f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.568394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1078/2161] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:21.573096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.574703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.581681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.582666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.582991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.583250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] PATH_INFO: `/v3/projects/0a77e47eee1d494b98efc955d69e3299/users/552dc2cdabb647d795ec3033af3f1843/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.588716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a77e47eee1d494b98efc955d69e3299, user_id=552dc2cdabb647d795ec3033af3f1843, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.591974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa65a03-38f2-4517-b384-e09f0cd4343d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.598976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd751b-f91f-4018-848b-b37f10847bfa None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.604883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1084/2162] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:21 2022] PUT /identity/v3/projects/0a77e47eee1d494b98efc955d69e3299/users/552dc2cdabb647d795ec3033af3f1843/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:21.625324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b679f-909b-47ae-a682-80600845eabf None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.625688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b679f-909b-47ae-a682-80600845eabf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.626032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b679f-909b-47ae-a682-80600845eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.661479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-435b679f-909b-47ae-a682-80600845eabf None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:21.663533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-435b679f-909b-47ae-a682-80600845eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.679814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.683842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.684142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.684689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] PATH_INFO: `/v3/projects/c71fe6ed832949aaa9eaab89690ead2d` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.687944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71fe6ed832949aaa9eaab89690ead2d)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.692012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.777863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1085/2163] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:21.782869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b679f-909b-47ae-a682-80600845eabf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.809738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b679f-909b-47ae-a682-80600845eabf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.811035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71fe6ed832949aaa9eaab89690ead2d', 'request_id': 'req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.825478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71fe6ed832949aaa9eaab89690ead2d', 'request_id': 'req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.836087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71fe6ed832949aaa9eaab89690ead2d', 'request_id': 'req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.863238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] The token cache is being invalidate because project c71fe6ed832949aaa9eaab89690ead2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:21.863687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.866452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:21.873531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1079/2164] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:21 2022] DELETE /identity/v3/projects/c71fe6ed832949aaa9eaab89690ead2d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:21.874621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.878804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.929076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.929766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.930057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.930486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.931272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:21.931596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:21.933245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:21.965561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1086/2165] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:21.966567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:21.968573 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:21.983515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c037791-2c54-4b32-a961-1f0f4e786e8f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:21.994254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:21.995785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:21.996052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:21.996308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:21.999589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.003877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.036571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091d5f9-1c31-405c-87d0-8824c1ebb7e3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.049039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.049260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1087/2166] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:21 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:22.050502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.050875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.051217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] PATH_INFO: `/v3/users/4f0a59c04e4b4a0886ac34e3b254d951` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.055327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0a59c04e4b4a0886ac34e3b254d951)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.055479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.057385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.161126 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4cf1f-ca2c-4f33-bcf3-baf6d2f03c7f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.166819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.167945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.168232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.168505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.169216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.171668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.206885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1088/2167] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:22 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:22.212012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.230144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22706899-cd81-4af6-adf4-85e1e2d27890 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.242131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.245023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.245311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.245590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.249364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.252933 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.281049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1089/2168] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:22.285813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.309424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6362c-eeed-49bc-891e-b8e2c4b929c3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.320821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.323554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.323949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.325230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.326029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.330118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.363106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1090/2169] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:22.368238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.391371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c020ac-805c-4197-a484-9ca1f7d35ff9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.417970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.423419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.425591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.426006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] PATH_INFO: `/v3/projects/559f77b69aa645ab9a26517f4ddde72c/users/3f1a61b30e0443ffb4f9fdb20187b9db/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.447324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0a59c04e4b4a0886ac34e3b254d951'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:22.448690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0a59c04e4b4a0886ac34e3b254d951'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:22.472981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0a59c04e4b4a0886ac34e3b254d951'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:22.475479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=559f77b69aa645ab9a26517f4ddde72c, user_id=3f1a61b30e0443ffb4f9fdb20187b9db, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.479036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.490289 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0a59c04e4b4a0886ac34e3b254d951'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:22.500255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1226f39a-aaf5-4af8-b2da-6e4853be560c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0a59c04e4b4a0886ac34e3b254d951'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:22.508433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1080/2170] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:21 2022] DELETE /identity/v3/users/4f0a59c04e4b4a0886ac34e3b254d951 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:22.511527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1091/2171] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:22 2022] PUT /identity/v3/projects/559f77b69aa645ab9a26517f4ddde72c/users/3f1a61b30e0443ffb4f9fdb20187b9db/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:22.527693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.528145 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.528276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.591788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] MFA Rules not processed for user `3f1a61b30e0443ffb4f9fdb20187b9db`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:22.593167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:22.706803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1081/2172] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:22.722492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.726858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:22.808424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2df7e-f7f7-44b9-84e0-301bfc8af11a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:22.867331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:22.868208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:22.868499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:22.868826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:22.882258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:22.885733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:22.905584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1092/2173] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:22.929269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:22.930053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.039843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eab7dd-ecc4-4ca5-962f-4df46dc97c84 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.049664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.050569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.050875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.051149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] PATH_INFO: `/v3/users/3f1a61b30e0443ffb4f9fdb20187b9db` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.056922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1a61b30e0443ffb4f9fdb20187b9db)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.059122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.140184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1a61b30e0443ffb4f9fdb20187b9db'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.140855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1a61b30e0443ffb4f9fdb20187b9db'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.166015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1a61b30e0443ffb4f9fdb20187b9db'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.188981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1a61b30e0443ffb4f9fdb20187b9db'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.199735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-01e16f0c-b018-4a84-b8f2-ce6eade3591c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1a61b30e0443ffb4f9fdb20187b9db'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.215781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.217006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1082/2174] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:22 2022] DELETE /identity/v3/users/3f1a61b30e0443ffb4f9fdb20187b9db => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:23.218533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.231584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.232399 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.239864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.253739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425832e5-cd41-4b40-9a36-a399b85e59fe service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.270185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:23.272779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.343878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.346091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.346388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.346686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] PATH_INFO: `/v3/projects/840eae3f0dae4460bde17738bb39615f` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.348004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=840eae3f0dae4460bde17738bb39615f)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.350496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.351974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1083/2175] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:23.361887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.364392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.407387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840eae3f0dae4460bde17738bb39615f', 'request_id': 'req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.413428 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840eae3f0dae4460bde17738bb39615f', 'request_id': 'req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.422922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840eae3f0dae4460bde17738bb39615f', 'request_id': 'req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.433899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe642b-9000-463d-81ae-aa6d0002d50f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.439723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] The token cache is being invalidate because project 840eae3f0dae4460bde17738bb39615f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:23.440175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.441077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ee4deba0-8f7a-4e83-a42e-1fd9fae78d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.443963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1093/2176] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:23 2022] DELETE /identity/v3/projects/840eae3f0dae4460bde17738bb39615f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:23.451551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8fb7c-67b4-41ec-bc66-5d6549031913 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.451985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8fb7c-67b4-41ec-bc66-5d6549031913 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.452261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8fb7c-67b4-41ec-bc66-5d6549031913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.481640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-35f8fb7c-67b4-41ec-bc66-5d6549031913 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:23.483442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-35f8fb7c-67b4-41ec-bc66-5d6549031913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.516432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.517184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.517470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.517751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.519809 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.559524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1094/2177] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:23.579750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.582949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.583371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.626853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:23.629294 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.649881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.651141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1095/2178] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:23.655779 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.656588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.688407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1084/2179] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:06:23.689444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.695690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:23.700461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1397f-45c5-4570-b89d-f15d5c450083 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.720529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a191f4-177b-42af-9a42-60ae7b44abf4 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.724870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.728695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.728984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.729259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.731251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:23.733812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.738622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.776089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.777025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.777312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.780587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] PATH_INFO: `/v3/users/44c2155428ef4d84942b43e1c27a3352` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.786967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c2155428ef4d84942b43e1c27a3352)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.789364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.805516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1096/2180] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:23.810021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.830660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac25d26-73c0-4ec3-9751-848a380432ab admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:23.836221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:23.837191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:23.837707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:23.838141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:23.839109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:23.841138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:23.932736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1097/2181] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:23 2022] POST /identity/v3/projects => generated 407 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:06:23.935150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:23.953500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c2155428ef4d84942b43e1c27a3352'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.955553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c2155428ef4d84942b43e1c27a3352'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.972512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c2155428ef4d84942b43e1c27a3352'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:23.998937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c2155428ef4d84942b43e1c27a3352'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:24.008315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c3a1e09b-e93a-4396-af2b-c6409b83a2aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c2155428ef4d84942b43e1c27a3352'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:24.015604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1085/2182] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:23 2022] DELETE /identity/v3/users/44c2155428ef4d84942b43e1c27a3352 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:24.020362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.020654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.021314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.051890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:24.053680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:24.132398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2cbee-227c-4f3c-97fd-8634b143c7b2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.139824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1086/2183] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:24.168017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.168866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.169335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.169622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.178878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.181001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.189418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.190917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:24.243332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1098/2184] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:23 2022] POST /identity/v3/users => generated 304 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:24.246770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.255093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:24.280831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8a020-a51e-47c2-b925-672d33d6e5bb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.290414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.291650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.293435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.294012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.296319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.299063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.316077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1099/2185] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:24.317951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.370723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f869c9-672a-4c32-89f2-41bac9a5b71a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.384128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.385071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.385217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceee0-3753-4ca2-9151-45a25cf85620 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.385798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.386250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.396977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.397938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.398221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.398496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.399267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.400909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.406824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.409410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ebbbb-ef79-4016-809f-38461cc0c0a7 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.430854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1100/2186] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:24.432313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.436513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1087/2187] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:06:24.452232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adb718-132a-4a1b-895d-64854e84dcc0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.474133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.477287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.478493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.480422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] PATH_INFO: `/v3/projects/64b462ad2d7144f092b957d286429118/users/ab959fa4fe1a465dbc506c79a7e9d07b/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.535886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b462ad2d7144f092b957d286429118, user_id=ab959fa4fe1a465dbc506c79a7e9d07b, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.540605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.588546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1101/2188] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:24 2022] PUT /identity/v3/projects/64b462ad2d7144f092b957d286429118/users/ab959fa4fe1a465dbc506c79a7e9d07b/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:24.608360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.609015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.609015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.670316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] MFA Rules not processed for user `ab959fa4fe1a465dbc506c79a7e9d07b`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:24.671677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:24.771754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1088/2189] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:24.776132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.905571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:24.907758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:24.923526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee2655-93b6-42f7-a2c5-a301cc551e5d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.935239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d3e25-c1f8-4502-b2cd-cf5c948d5d13 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:24.940689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.941389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.941672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.942002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.943002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.946167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:24.950813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:24.952835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:24.956515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:24.957515 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] PATH_INFO: `/v3/projects/559f77b69aa645ab9a26517f4ddde72c` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:24.963008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559f77b69aa645ab9a26517f4ddde72c)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:24.971087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.005832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1102/2190] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:24 2022] POST /identity/v3/projects => generated 407 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:25.008769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.047452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559f77b69aa645ab9a26517f4ddde72c', 'request_id': 'req-1c122dba-c41c-4b5d-8729-d57ac9fa8964'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:25.055044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559f77b69aa645ab9a26517f4ddde72c', 'request_id': 'req-1c122dba-c41c-4b5d-8729-d57ac9fa8964'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:25.065848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559f77b69aa645ab9a26517f4ddde72c', 'request_id': 'req-1c122dba-c41c-4b5d-8729-d57ac9fa8964'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:25.101279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] The token cache is being invalidate because project 559f77b69aa645ab9a26517f4ddde72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:25.101570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:25.103063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1c122dba-c41c-4b5d-8729-d57ac9fa8964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:25.110818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1089/2191] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:24 2022] DELETE /identity/v3/projects/559f77b69aa645ab9a26517f4ddde72c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:25.112821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768975-2502-40e8-b5f1-ecb333b0b08e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.113186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768975-2502-40e8-b5f1-ecb333b0b08e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.113534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768975-2502-40e8-b5f1-ecb333b0b08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.195071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-82768975-2502-40e8-b5f1-ecb333b0b08e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:25.199409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-82768975-2502-40e8-b5f1-ecb333b0b08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:25.204360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b423078-f4f4-482f-808d-91a807dba3a3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.303502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.304552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.305113 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.306051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.308291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.313140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.347747 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1090/2192] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:25.349703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.349989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.350262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.378778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1103/2193] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/users => generated 310 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:25.381645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:25.382197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.383232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:25.389141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:25.396697 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1091/2194] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:25.397587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.407689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5225ce-915a-4173-aaf8-0a88bb14c29c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.409596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3026f4-2982-49cd-8d64-292776b77e1b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.413717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.414675 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.415010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.415431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.416853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:25.416853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.419077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.420827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.421761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.422362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.422788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.426760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.428866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.437827 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1092/2195] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:25.442308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.449651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1104/2196] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:25.451644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.458722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a583-43d7-45e4-b2c3-5bc87447c8ed admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.463972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.469938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.470310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.470585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.471058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8f7b-532a-4b02-a2e9-5b44e72c86bb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.471418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.474108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.477622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.479091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.479760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.480277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] PATH_INFO: `/v3/projects/58cf78e406e4445793b13c1428dc4d80/users/11e8ae7a4c254c16820116570f930e60/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.507021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cf78e406e4445793b13c1428dc4d80, user_id=11e8ae7a4c254c16820116570f930e60, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.511803 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.512674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1093/2197] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:25.516914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.568223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1105/2198] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:25 2022] PUT /identity/v3/projects/58cf78e406e4445793b13c1428dc4d80/users/11e8ae7a4c254c16820116570f930e60/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:25.572820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.623168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b78df5-3c01-4454-98ca-f4bec1254b26 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.724374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc58be-14d7-4e35-95cb-caa96541fc89 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.741932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.742782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.743068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.743341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.744100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.746914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.769861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1106/2199] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:25.773870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.785172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.785887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.786170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.786442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.787793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.789150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.801350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc929b35-a4b9-4abf-8816-d7c56d7853a0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.811671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:25.813125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.813529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.813856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] PATH_INFO: `/v3/projects/58cf78e406e4445793b13c1428dc4d80/users/11e8ae7a4c254c16820116570f930e60/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.821644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cf78e406e4445793b13c1428dc4d80, user_id=11e8ae7a4c254c16820116570f930e60, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:25.832636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2565b9-20a2-48a5-9ea7-1d807ea45ff3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:25.834716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1094/2200] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:25.840162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:25.869203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1107/2201] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:25 2022] PUT /identity/v3/projects/58cf78e406e4445793b13c1428dc4d80/users/11e8ae7a4c254c16820116570f930e60/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:25.872247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec19a6e-b509-436c-a33e-fec6c62bd91a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:25.882544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:25.883321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:25.884320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:25.991059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] MFA Rules not processed for user `11e8ae7a4c254c16820116570f930e60`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:25.992961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.050907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.051983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.052286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.052574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.053353 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.055755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:26.085495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1095/2202] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:26.086433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.090011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.104058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40e82e-2f65-4eb3-b4a5-52b3f1a837c7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:26.110290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.111520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.111815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.112091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] PATH_INFO: `/v3/projects/fb1cfa67364c44cbb6a14dae79f3f3e2` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.115383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1cfa67364c44cbb6a14dae79f3f3e2)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.117469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:26.183935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1cfa67364c44cbb6a14dae79f3f3e2', 'request_id': 'req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:26.184450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1108/2203] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:25 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:26.185801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.191420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1cfa67364c44cbb6a14dae79f3f3e2', 'request_id': 'req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:26.203616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1cfa67364c44cbb6a14dae79f3f3e2', 'request_id': 'req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:26.221199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d5261-384b-4bd5-8523-74ccfa47175e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:26.238622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] The token cache is being invalidate because project fb1cfa67364c44cbb6a14dae79f3f3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:26.238622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:26.238930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:26.242036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1096/2204] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:26 2022] DELETE /identity/v3/projects/fb1cfa67364c44cbb6a14dae79f3f3e2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:26.242739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.269570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.409719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.410738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.411403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.411777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.412640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.414782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:26.440822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1109/2205] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:26.442168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.457532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.475620 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7471ae-3fca-424c-8392-49ba8d2f6ddd admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:26.485721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.486419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.486934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.487225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.492618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84488b3-0173-4f66-b2aa-441ceffc1db3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:26.494083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.505540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.506477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.506785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.507061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] PATH_INFO: `/v3/projects/1910492433a64a47a317e46e45febfbe/users/beea86578d8e4ea7b466e99f376a4efa/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.541980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1910492433a64a47a317e46e45febfbe, user_id=beea86578d8e4ea7b466e99f376a4efa, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.544729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b42f37-c871-4429-8451-a76b0de384b2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:26.569208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1110/2206] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:26 2022] PUT /identity/v3/projects/1910492433a64a47a317e46e45febfbe/users/beea86578d8e4ea7b466e99f376a4efa/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:26.579656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.579956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.580209 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.600815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.602489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:26.616183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1097/2207] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:26.640118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] MFA Rules not processed for user `beea86578d8e4ea7b466e99f376a4efa`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:26.641379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:26.807384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1111/2208] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:26.808564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.828291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa6532-f49c-4d5f-bf57-497b84f9def0 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:26.907924 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:26.992940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:26.993642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:26.993927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:26.994202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:26.994966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:26.996927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.048680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783b351-f3fd-4824-b14b-3c1f0b90d6b8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:27.069788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:27.070532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.071041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.071330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.073382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:27.086153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1098/2209] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:26 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:27.087477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:27.258297 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2eb85d-e1bd-46fd-9e03-4adb1db9b26f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:27.270194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:27.271470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.272049 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.272358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.273172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:27.275333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.310500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:27.315069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.319694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1099/2210] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:27 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:27.323900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:27.351208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1112/2211] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:27.361134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bc2a4-d1f5-40ab-8597-d87988df2f7c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:27.415898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:27.416843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.417288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.417711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.421828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:27.424526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.438615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1100/2212] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:06:27.442368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:27.461303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c46b26-8725-45fb-b691-0c7ad9e84313 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:27.476777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:27.477305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.477631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.477920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.478738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:27.493855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adcbf4-0a90-484e-9cd1-2e620ca933a2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.542838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1113/2213] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:27.544348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:27.560419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e542846-c26c-45cc-ac2b-f853a3844660 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:27.574812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:27.576295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.576793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.577534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] PATH_INFO: `/v3/projects/1ee133eb00ca4fa2838c1ad014330dc4/users/900e6e8fca78409e9a9da16bb1d1be0c/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.620677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee133eb00ca4fa2838c1ad014330dc4, user_id=900e6e8fca78409e9a9da16bb1d1be0c, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:27.630065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:27.654772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1101/2214] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:27 2022] PUT /identity/v3/projects/1ee133eb00ca4fa2838c1ad014330dc4/users/900e6e8fca78409e9a9da16bb1d1be0c/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:27.665611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:27.666155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:27.666484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:27.734942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] MFA Rules not processed for user `900e6e8fca78409e9a9da16bb1d1be0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:27.737721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:27.900414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:27.901751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1114/2215] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:28.026896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947accab-2ba7-47d8-b10e-0a53dd61629e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.034423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.035666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.036163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.036741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.037738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.040106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.074818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1102/2216] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:27 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:06:28.078689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.094415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2224b7e-f2e7-4c97-b6ac-f284dec78d5e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.160233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.161001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.161311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.161787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.162896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.167630 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.198842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1115/2217] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:28 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:28.200604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.212454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c92781-8908-44b2-a0b5-e18a4cdb7491 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.218491 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.219454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.221371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.221833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.223787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.225682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.241370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1103/2218] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:28.245826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.267093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b3947-3c57-48b4-9735-9c2dd784ca6a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.272693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.274852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.275288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.275827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] PATH_INFO: `/v3/projects/5e12df5feb19413d86f9e51eb39d0abd/users/27be540d05264a85a54194a8c4b8ca69/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.305051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e12df5feb19413d86f9e51eb39d0abd, user_id=27be540d05264a85a54194a8c4b8ca69, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.307955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.331530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1116/2219] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:28 2022] PUT /identity/v3/projects/5e12df5feb19413d86f9e51eb39d0abd/users/27be540d05264a85a54194a8c4b8ca69/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:28.333903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.348545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45181eb-005d-4eda-9f55-6af35f325ac8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.471457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.472267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.472754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.473229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.474155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.476743 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9effe-2e71-49fd-be37-8100ea20eed7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.500178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1104/2220] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:28.505089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.529623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab79c3-3011-4a76-acde-908a6d3c62bc admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.539523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.540481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.540757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.541786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] PATH_INFO: `/v3/projects/5e12df5feb19413d86f9e51eb39d0abd/users/27be540d05264a85a54194a8c4b8ca69/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.544723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e12df5feb19413d86f9e51eb39d0abd, user_id=27be540d05264a85a54194a8c4b8ca69, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.549272 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.571921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1117/2221] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:28 2022] PUT /identity/v3/projects/5e12df5feb19413d86f9e51eb39d0abd/users/27be540d05264a85a54194a8c4b8ca69/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:28.574254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c0d1-9fc7-4450-bb30-565dd82915b1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.574806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c0d1-9fc7-4450-bb30-565dd82915b1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.575285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23c0d1-9fc7-4450-bb30-565dd82915b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.651414 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2b23c0d1-9fc7-4450-bb30-565dd82915b1 None None] MFA Rules not processed for user `27be540d05264a85a54194a8c4b8ca69`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:28.653032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2b23c0d1-9fc7-4450-bb30-565dd82915b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:28.780578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1105/2222] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:28.793181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:28.878673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eadd38-5da8-453e-934e-1b25938ceb26 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:28.884546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:28.885299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:28.886141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:28.886491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:28.961391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:28.963087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:28.973836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1118/2223] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:29.947475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec037-9c56-4367-9d94-7a1707ed47f3 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:29.947927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec037-9c56-4367-9d94-7a1707ed47f3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:29.948017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aec037-9c56-4367-9d94-7a1707ed47f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:29.979017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-54aec037-9c56-4367-9d94-7a1707ed47f3 None None] MFA Rules not processed for user `552dc2cdabb647d795ec3033af3f1843`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:29.980248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-54aec037-9c56-4367-9d94-7a1707ed47f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:30.048451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1106/2224] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:30.059616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:30.061205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:30.139125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44cd83-6835-4293-b9f6-44eca0f8e27b service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:30.144523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:30.145173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:30.145454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:30.146073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:30.147855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:30.207056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:30.208647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:30.218016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1119/2225] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:31.776206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:31.776698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:31.776794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:31.797333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] MFA Rules not processed for user `7e73b5e40fca4a40b235f934b7573f22`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:31.798636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:31.806698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1107/2226] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:34.921181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:34.922658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:34.934019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db16d7e-0e32-4956-a147-65e9b56a3eff service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:34.937663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:34.938323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:34.938607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:34.938921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:34.994798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:34.996230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:35.005943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1120/2227] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:35.552568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:35.562420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d4857-856d-4c58-84ee-52ecdad73822 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:35.566151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:35.566837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:35.567119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:35.567391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:35.576762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:35.578940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88590192-05e0-4171-987b-29c7035e86c9 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:35.588687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1108/2228] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:37.217815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:37.219437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:37.288712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067c52c-4e29-48fd-85f8-9f8333518568 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:37.295746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:37.296943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:37.297296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:37.297606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] PATH_INFO: `/v3/users/ab959fa4fe1a465dbc506c79a7e9d07b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:37.299025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab959fa4fe1a465dbc506c79a7e9d07b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:37.301307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:37.348002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab959fa4fe1a465dbc506c79a7e9d07b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.356170 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab959fa4fe1a465dbc506c79a7e9d07b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.367860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab959fa4fe1a465dbc506c79a7e9d07b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.368635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab959fa4fe1a465dbc506c79a7e9d07b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.369363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab959fa4fe1a465dbc506c79a7e9d07b'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.382528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1121/2229] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:37 2022] DELETE /identity/v3/users/ab959fa4fe1a465dbc506c79a7e9d07b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:37.387246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:37.387753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:37.387862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:37.405805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:37.407374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:37.470536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1109/2230] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:37.480511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:37.481903 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:37.545483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570a04b-f6ea-443c-b68a-2fe318abad21 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:37.549380 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:37.550031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:37.550311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:37.550581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:37.559496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:37.560916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae87e-e106-4b0f-b521-73907f12eee1 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:37.570427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1122/2231] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:37.843254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:37.844790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:37.864616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c1ffd-2c33-45d3-a7a2-b7dd170c04d4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:37.886973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:37.888001 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:37.888348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:37.888691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] PATH_INFO: `/v3/projects/64b462ad2d7144f092b957d286429118` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:37.889130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:37.889423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:37.889749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:37.890149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b462ad2d7144f092b957d286429118)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:37.892404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:37.909800 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] MFA Rules not processed for user `b687f70831024cac87826377235bd5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:37.911088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:37.940529 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b462ad2d7144f092b957d286429118', 'request_id': 'req-bfab4d1d-13c9-4dd8-805b-74ec6286019d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.946039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b462ad2d7144f092b957d286429118', 'request_id': 'req-bfab4d1d-13c9-4dd8-805b-74ec6286019d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.952366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b462ad2d7144f092b957d286429118', 'request_id': 'req-bfab4d1d-13c9-4dd8-805b-74ec6286019d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.965509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] The token cache is being invalidate because project 64b462ad2d7144f092b957d286429118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:37.965797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.966348 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1123/2232] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:37.966482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:37.967956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1110/2233] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:37 2022] DELETE /identity/v3/projects/64b462ad2d7144f092b957d286429118 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:37.971807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:37.983392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867a450-81ec-44cb-90d8-8dc3fab1f356 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:38.038087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:38.038995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:38.039273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:38.039550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] PATH_INFO: `/v3/users/11e8ae7a4c254c16820116570f930e60` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:38.040854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e8ae7a4c254c16820116570f930e60)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:38.042853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:38.094686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e8ae7a4c254c16820116570f930e60'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.104967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e8ae7a4c254c16820116570f930e60'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.119200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e8ae7a4c254c16820116570f930e60'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.120150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e8ae7a4c254c16820116570f930e60'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.120672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9fec1929-19ba-41cd-bd28-d8577643648b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e8ae7a4c254c16820116570f930e60'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.136676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1124/2234] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:37 2022] DELETE /identity/v3/users/11e8ae7a4c254c16820116570f930e60 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:38.744846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:38.746457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:38.785259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab4d1d-13c9-4dd8-805b-74ec6286019d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:38.848000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:38.848881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:38.849163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:38.849437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] PATH_INFO: `/v3/projects/58cf78e406e4445793b13c1428dc4d80` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:38.850627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cf78e406e4445793b13c1428dc4d80)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:38.852783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:38.906584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cf78e406e4445793b13c1428dc4d80', 'request_id': 'req-47407129-1ae0-4333-861f-91b271eb7979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.912436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cf78e406e4445793b13c1428dc4d80', 'request_id': 'req-47407129-1ae0-4333-861f-91b271eb7979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.921019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cf78e406e4445793b13c1428dc4d80', 'request_id': 'req-47407129-1ae0-4333-861f-91b271eb7979'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.935636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] The token cache is being invalidate because project 58cf78e406e4445793b13c1428dc4d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:38.935925 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.936539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-47407129-1ae0-4333-861f-91b271eb7979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:38.938166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1111/2235] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:38 2022] DELETE /identity/v3/projects/58cf78e406e4445793b13c1428dc4d80 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:38.943304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:38.943777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:38.943897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:38.973589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:38.975183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.035055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1125/2236] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:39.043462 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.043755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.044119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.063370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:39.064706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.072868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1112/2237] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:39.077320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.088909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dc30c-6278-41c3-aef2-d5c6c82b6a2d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.095874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.096557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.096875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.097439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.098347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:39.098956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.101383 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.113912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1126/2238] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:39.118704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.128339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9196-f340-4002-8848-2cf0386fbff1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.133522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.134201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.134478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.134786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.135536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.137655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.169202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1113/2239] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:39 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:39.173736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.187004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e9228-9528-4068-96af-74c2f0be053d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.247091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.247855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.248132 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.248432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.249176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.251962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.274125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1127/2240] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:39 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:39.278677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.289609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc12163-483c-4253-9ac8-b920e2d5ca68 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.294438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.295165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.295453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.295734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.296469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.298086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.310890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1114/2241] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:39.315291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.325419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89219b73-569c-4efa-b5f4-f7b0af217cf9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.330370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.331168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.331338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.331653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.332377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.333980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7aeb7-f8ee-4ce0-be9a-776a9037c12a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.345741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1128/2242] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:39.363903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.374563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c75c5d-a323-4056-843f-d55b28e6d61b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.379389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.380424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.380784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.381167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] PATH_INFO: `/v3/projects/3708c7a8a8ca45b3b4e3e764b9b7f8fd/users/23977e96394d48f2b72a04d6905790c7/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.397867 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3708c7a8a8ca45b3b4e3e764b9b7f8fd, user_id=23977e96394d48f2b72a04d6905790c7, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.400677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.416523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1115/2243] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:39 2022] PUT /identity/v3/projects/3708c7a8a8ca45b3b4e3e764b9b7f8fd/users/23977e96394d48f2b72a04d6905790c7/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:39.422052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.422368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.422661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.441483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:39.442769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.502547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1129/2244] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:39.512538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.514439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.571059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b6801-a28e-4282-a6ce-027529210df6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.574744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.575408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.575691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.575968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.585367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.586857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94364b89-0b7f-4bf7-9ee5-4c49023916a4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.596531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1116/2245] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:39.741853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:39.743393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.756008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52abe6-ab2d-418b-a3e9-28634fbb6303 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:39.763182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:39.764082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.764361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.764629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] PATH_INFO: `/v3/users/beea86578d8e4ea7b466e99f376a4efa` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.767019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=beea86578d8e4ea7b466e99f376a4efa)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:39.769530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:39.845048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beea86578d8e4ea7b466e99f376a4efa'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:39.860661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beea86578d8e4ea7b466e99f376a4efa'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:39.886119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beea86578d8e4ea7b466e99f376a4efa'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:39.887180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beea86578d8e4ea7b466e99f376a4efa'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:39.888061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beea86578d8e4ea7b466e99f376a4efa'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:39.905414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1130/2246] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:39 2022] DELETE /identity/v3/users/beea86578d8e4ea7b466e99f376a4efa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:39.910387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:39.910901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:39.911004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:39.931080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:39.932286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:39.999468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1117/2247] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:40.009948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:40.011599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:40.074830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd58b7-ff6d-4c53-8845-41fa01c81e1f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:40.078808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:40.079413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:40.079698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:40.079987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:40.091451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:40.093006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e8f05-96aa-4f48-afb1-d0fb54d5ee39 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:40.103587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1131/2248] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:40.656448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:40.658267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:40.680887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac667ef1-d176-45d5-8d8a-f06a9c7b9bcb None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:40.702868 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:40.704164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:40.704494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:40.704824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:40.705157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:40.705779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:40.706841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] PATH_INFO: `/v3/projects/1910492433a64a47a317e46e45febfbe` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:40.708630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1910492433a64a47a317e46e45febfbe)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:40.712382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:40.778936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] MFA Rules not processed for user `23977e96394d48f2b72a04d6905790c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:40.780168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:40.805700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1910492433a64a47a317e46e45febfbe', 'request_id': 'req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:40.813838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1910492433a64a47a317e46e45febfbe', 'request_id': 'req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:40.822536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1910492433a64a47a317e46e45febfbe', 'request_id': 'req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:40.845796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] The token cache is being invalidate because project 1910492433a64a47a317e46e45febfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:40.846402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:40.847125 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:40.848994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1118/2249] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:40 2022] DELETE /identity/v3/projects/1910492433a64a47a317e46e45febfbe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:40.855342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:40.855342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:40.889436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1132/2250] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:40.896173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:40.907415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:40.930487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae5a12-dacb-40a4-9d1f-fca3d6cd3643 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:40.937307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:40.938621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:40.939163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:40.939801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] PATH_INFO: `/v3/users/900e6e8fca78409e9a9da16bb1d1be0c` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:40.941252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=900e6e8fca78409e9a9da16bb1d1be0c)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:40.943608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.034570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a356b-18ed-4e1f-ba6f-129b09294822 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.047046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900e6e8fca78409e9a9da16bb1d1be0c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.047661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.049208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.049492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.049762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.050572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900e6e8fca78409e9a9da16bb1d1be0c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.052146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.057915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.070534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900e6e8fca78409e9a9da16bb1d1be0c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.098301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900e6e8fca78409e9a9da16bb1d1be0c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.112482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900e6e8fca78409e9a9da16bb1d1be0c'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.130995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1133/2251] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:40 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:41.132051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.133452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1119/2252] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:40 2022] DELETE /identity/v3/users/900e6e8fca78409e9a9da16bb1d1be0c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:41.137199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:41.208030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8545-f574-4c41-9619-fe7c1db557a5 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.310583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.311496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.311875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.312246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.313139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.315342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.340388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1134/2253] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:41 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:41.345101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.363908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362bbd7-bfde-4545-a15c-bb4f3a425c9d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.368971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.369661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.369949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.370229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.371182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.372843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.383838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1120/2254] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:41.387906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.399023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5b3f7-caa9-4614-94a2-3c3d7082ea66 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.403751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.404659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.404943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.405222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] PATH_INFO: `/v3/projects/4cbdf872d6654571904169fdc02602ea/users/b7187d673be84f3dace1d0aa497ff431/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.426881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbdf872d6654571904169fdc02602ea, user_id=b7187d673be84f3dace1d0aa497ff431, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.429808 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.452508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1135/2255] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:41 2022] PUT /identity/v3/projects/4cbdf872d6654571904169fdc02602ea/users/b7187d673be84f3dace1d0aa497ff431/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:41.456621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.466721 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097343-c7b9-43b1-9c79-fcb6bcdb8de6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.538450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.539269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.539610 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.540102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.540965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.542684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.553534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1121/2256] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:41.557732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.571000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1337-5286-437a-9865-19f937aa56fe admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.574510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.575469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.575780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.576062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] PATH_INFO: `/v3/projects/4cbdf872d6654571904169fdc02602ea/users/b7187d673be84f3dace1d0aa497ff431/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.578171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbdf872d6654571904169fdc02602ea, user_id=b7187d673be84f3dace1d0aa497ff431, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.580966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.594752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1136/2257] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:41 2022] PUT /identity/v3/projects/4cbdf872d6654571904169fdc02602ea/users/b7187d673be84f3dace1d0aa497ff431/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:41.749707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.752093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:41.767837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf9abb-9627-4754-8eae-d8fb7007e698 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:41.853213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:41.854212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:41.854603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:41.855010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] PATH_INFO: `/v3/projects/1ee133eb00ca4fa2838c1ad014330dc4` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:41.856375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee133eb00ca4fa2838c1ad014330dc4)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:41.858465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:41.951758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee133eb00ca4fa2838c1ad014330dc4', 'request_id': 'req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.958151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee133eb00ca4fa2838c1ad014330dc4', 'request_id': 'req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.968101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee133eb00ca4fa2838c1ad014330dc4', 'request_id': 'req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.988034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] The token cache is being invalidate because project 1ee133eb00ca4fa2838c1ad014330dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:41.988438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.989150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:41.994014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1122/2258] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:41 2022] DELETE /identity/v3/projects/1ee133eb00ca4fa2838c1ad014330dc4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:41.996045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:41.997998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:42.011079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4725-583a-477e-8467-003666242f7f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:42.081918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:42.082962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:42.083288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:42.083833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] PATH_INFO: `/v3/users/27be540d05264a85a54194a8c4b8ca69` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:42.084943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27be540d05264a85a54194a8c4b8ca69)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:42.087057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:42.147404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27be540d05264a85a54194a8c4b8ca69'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:42.157965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27be540d05264a85a54194a8c4b8ca69'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:42.173714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27be540d05264a85a54194a8c4b8ca69'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:42.174357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27be540d05264a85a54194a8c4b8ca69'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:42.174980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-a457c7f0-2b20-4a8d-9929-edeea8fd372c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27be540d05264a85a54194a8c4b8ca69'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:42.193279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1137/2259] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:06:41 2022] DELETE /identity/v3/users/27be540d05264a85a54194a8c4b8ca69 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:06:43.097671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.113571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b62d-1da3-4bc8-86a3-453f312f6c2d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.232018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.232574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.232574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.259649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.260731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.261168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.261795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] PATH_INFO: `/v3/projects/5e12df5feb19413d86f9e51eb39d0abd` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.263314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e12df5feb19413d86f9e51eb39d0abd)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.265469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.292306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] MFA Rules not processed for user `b7187d673be84f3dace1d0aa497ff431`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:43.293680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:43.344885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e12df5feb19413d86f9e51eb39d0abd', 'request_id': 'req-8fc7a578-ed84-4525-9da5-98814dc56ca6'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:43.352028 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e12df5feb19413d86f9e51eb39d0abd', 'request_id': 'req-8fc7a578-ed84-4525-9da5-98814dc56ca6'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:43.361347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e12df5feb19413d86f9e51eb39d0abd', 'request_id': 'req-8fc7a578-ed84-4525-9da5-98814dc56ca6'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:43.380364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] The token cache is being invalidate because project 5e12df5feb19413d86f9e51eb39d0abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:06:43.380819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:43.381549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8fc7a578-ed84-4525-9da5-98814dc56ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:06:43.383308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1123/2260] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:06:43 2022] DELETE /identity/v3/projects/5e12df5feb19413d86f9e51eb39d0abd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:43.390218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec26c-120b-4cfa-a750-b098a1deba31 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.390739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec26c-120b-4cfa-a750-b098a1deba31 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.391325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcec26c-120b-4cfa-a750-b098a1deba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.396339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1138/2261] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:43.407344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.408945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:43.421327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5bcec26c-120b-4cfa-a750-b098a1deba31 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:43.423043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5bcec26c-120b-4cfa-a750-b098a1deba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:43.491897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cdbbb-9502-400e-ae04-a13638d37cc1 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.530889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1124/2262] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:06:43.538617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.538936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.539211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.564190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:43.565705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:43.575445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1125/2263] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:43.580759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.582346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.583271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.583598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.584169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.588866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:43.599459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6a76-5404-4372-8c2e-dec894e7f9bc None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.604656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.605317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.605594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.605862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.606589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:06:43.606934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.608538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.623658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1126/2264] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:06:43.627798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.639120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd471c48-e8fa-415d-a56a-767b08088796 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.644392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.645130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.645993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.646989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.648040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.651081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.675652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.677214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.690124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1139/2265] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:06:43.706712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1127/2266] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:06:43 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:06:43.710852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.725658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a527-247d-4854-9047-a165dcc6d5e0 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.821824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.822624 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.823051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.823427 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.824265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.827443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.884746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1140/2267] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:06:43 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:06:43.889045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.904444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be29e8-5151-4289-8f22-e3548ae72829 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.922716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.925584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.925879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.926164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.927725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.930614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:43.943335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1128/2268] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:43.948196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:43.967222 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd58d20-987c-4eee-bc7a-ff22e7e2bcbc admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:43.977659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:43.979248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:43.979728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:43.980386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:43.981969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:43.984181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814c63e-1148-4ecb-be04-155c857159ce admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:44.008775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1141/2269] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:06:44.013445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:44.035074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6c6fe-9aea-447c-8830-dde3b9af6a90 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:44.059405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:44.060317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:44.060761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:44.061211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] PATH_INFO: `/v3/projects/81979805e0b04b1dadba79875ca38b79/users/7ab87b3adf9940a59975a8d5d8a27744/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:44.093142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81979805e0b04b1dadba79875ca38b79, user_id=7ab87b3adf9940a59975a8d5d8a27744, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:44.099788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:44.126270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1129/2270] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:06:44 2022] PUT /identity/v3/projects/81979805e0b04b1dadba79875ca38b79/users/7ab87b3adf9940a59975a8d5d8a27744/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:06:44.137813 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:44.138099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:44.138372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:44.176825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] MFA Rules not processed for user `7ab87b3adf9940a59975a8d5d8a27744`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:06:44.188734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:44.283121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1142/2271] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:06:44.296338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:44.298479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:44.370165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c5e-56ea-47ac-90c3-71c5afe9e67a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:44.373976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:44.374671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:44.375041 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:44.375328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:44.386503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:44.388008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:44.400157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1130/2272] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:06:46.298398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:06:46.300057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:46.311946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b546-2101-4ad5-af4d-3061f0202037 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:06:46.316263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:06:46.316727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:06:46.317069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:06:46.317287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:06:46.319392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:06:46.391692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:06:46.393431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:06:46.403906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1143/2273] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:06:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:08.673374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:08.675037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:08.770365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83118eaa-bcd8-4e18-8ca8-03aadb0d452a service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:08.777449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:08.778118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:08.778398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:08.778706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:08.780608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:08.792198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:08.793794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95c75-44a1-480d-94b3-fabdf725d7f1 service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:08.803542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1131/2274] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:11.988885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:12.067900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fb110-83d5-4469-ad7e-fab5831e5e90 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:12.072482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:12.073431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:12.073711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:12.073981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] PATH_INFO: `/v3/users/7ab87b3adf9940a59975a8d5d8a27744` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:12.075432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab87b3adf9940a59975a8d5d8a27744)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:12.077369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:12.138054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab87b3adf9940a59975a8d5d8a27744'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.166314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab87b3adf9940a59975a8d5d8a27744'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.197270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab87b3adf9940a59975a8d5d8a27744'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.198199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab87b3adf9940a59975a8d5d8a27744'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.199249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab87b3adf9940a59975a8d5d8a27744'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.226830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1144/2275] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:11 2022] DELETE /identity/v3/users/7ab87b3adf9940a59975a8d5d8a27744 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:12.231218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:12.232065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:12.232692 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:12.253828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:12.255387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:12.366859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1132/2276] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:07:12.373010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:12.374669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:12.436756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7603e9-51f4-4c91-a2cb-2a1358cbfdd3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:12.440658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:12.441506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:12.442271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:12.442557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:12.456007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:12.456007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad421-c18f-4745-bc85-aa0631c2e154 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:12.466122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1145/2277] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:12.789185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:12.791160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:12.814047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9a412-b437-406c-936f-7f96ce0d7768 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:12.821920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:12.823019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:12.823488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:12.823765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] PATH_INFO: `/v3/projects/81979805e0b04b1dadba79875ca38b79` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:12.825020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81979805e0b04b1dadba79875ca38b79)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:12.827166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:12.892583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81979805e0b04b1dadba79875ca38b79', 'request_id': 'req-a2b6d487-2836-46c2-8ce2-8425601d04e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.901385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81979805e0b04b1dadba79875ca38b79', 'request_id': 'req-a2b6d487-2836-46c2-8ce2-8425601d04e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.907651 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81979805e0b04b1dadba79875ca38b79', 'request_id': 'req-a2b6d487-2836-46c2-8ce2-8425601d04e7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.922252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] The token cache is being invalidate because project 81979805e0b04b1dadba79875ca38b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:12.922541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.923342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-a2b6d487-2836-46c2-8ce2-8425601d04e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:12.924995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1133/2278] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:12 2022] DELETE /identity/v3/projects/81979805e0b04b1dadba79875ca38b79 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:12.930484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:12.930824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:12.931167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:12.949617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:12.950859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:13.010071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1146/2279] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:13.017953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.018242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.018518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.038689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:13.039891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:13.048806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1134/2280] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:13.052971 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.063114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caa3a6-cb27-4a92-a98d-4e2951f4c0c8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.068411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.069064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.069343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.069638 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.070338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:07:13.070641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.072268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.084552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1147/2281] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:07:13.088989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.098527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f2c16-dcdd-49fe-96ce-c2dee82fe39e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.103635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.104279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.104564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.104842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.105556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.107619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.135099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1135/2282] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:13.139517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.150124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60207546-6254-4634-b1cf-e41e4fc892d4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.204189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.204860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.205144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.205419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.206105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.208049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.230821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1148/2283] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:07:13 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:13.235308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.245718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976d3ec-e1ed-45d8-9805-629c0b6c696a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.250474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.251163 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.251449 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.251727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.252569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.254173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.265056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1136/2284] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:13.269300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.279962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad9ca0-ec22-4e93-a5d1-a25fa194ca6f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.285605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.286270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.286558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.286865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.287596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.289193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfea8d-29e6-469a-9b2c-06635616171d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.299517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1149/2285] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:13.303693 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.314976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917fd77-ff83-4bd2-bfe9-45354de05cb4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.320489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.321523 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.321912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.322211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] PATH_INFO: `/v3/projects/c4a61874308747efa6cf0456be5f46b6/users/865b26ccfed74865b856e8c3d33e3574/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.338172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a61874308747efa6cf0456be5f46b6, user_id=865b26ccfed74865b856e8c3d33e3574, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.344998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.355814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1137/2286] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:13 2022] PUT /identity/v3/projects/c4a61874308747efa6cf0456be5f46b6/users/865b26ccfed74865b856e8c3d33e3574/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:13.361174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354c34-116d-4188-82f4-6f27d2d32cae None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.361470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354c34-116d-4188-82f4-6f27d2d32cae None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.361750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354c34-116d-4188-82f4-6f27d2d32cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.379172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d4354c34-116d-4188-82f4-6f27d2d32cae None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:13.380369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d4354c34-116d-4188-82f4-6f27d2d32cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:13.444243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1150/2287] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:07:13.454225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:13.455982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:13.512728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b329ad-7e4f-4c67-bf7a-1b274629d606 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:13.516263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:13.516907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:13.517188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:13.517457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:13.526841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:13.528267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:13.537967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1138/2288] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:17.894403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:17.895925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:17.896291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:17.928617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] MFA Rules not processed for user `865b26ccfed74865b856e8c3d33e3574`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:17.930437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:18.040064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1151/2289] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:18.042171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.057372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c93489-87e5-42fd-987c-9175ee796162 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.066828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.067806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.068240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.068526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.069227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.078018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.112388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1139/2290] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:07:18 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:07:18.114027 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.126570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e5ad-f3cf-4111-9644-e86db6795140 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.193321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.194009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.194290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.194562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.195339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.198243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.231953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1152/2291] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:07:18 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:18.233555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.245020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59ebf3-bd6e-406f-b4e7-8c3c6d17d870 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.250512 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.251446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.251640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.251885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.252781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.255053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.268210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1140/2292] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:07:18.271832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.283012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cfd22-c9ef-4f77-81b9-8d85001f4ee3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.288479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.289484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.289870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.290419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] PATH_INFO: `/v3/projects/f56218aa01a44bdab4d61c77052b01ff/users/9e5ca06ce6c54d79a96240ed915a814f/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.308026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56218aa01a44bdab4d61c77052b01ff, user_id=9e5ca06ce6c54d79a96240ed915a814f, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.310497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.327474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1153/2293] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:18 2022] PUT /identity/v3/projects/f56218aa01a44bdab4d61c77052b01ff/users/9e5ca06ce6c54d79a96240ed915a814f/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:07:18.331645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.343212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92cd44-6ae4-485f-9050-d0f98a61678e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.423935 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.424704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.425051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.425400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.426196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.427936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5305eaf-a5c9-42a9-9ea6-1b73001ce0a2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.438509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1141/2294] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:18.442918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:18.472775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff4216-96a0-4b08-b3de-7d4cb9aa7006 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:18.477668 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:18.479050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.479614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.479891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] PATH_INFO: `/v3/projects/f56218aa01a44bdab4d61c77052b01ff/users/9e5ca06ce6c54d79a96240ed915a814f/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.482019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56218aa01a44bdab4d61c77052b01ff, user_id=9e5ca06ce6c54d79a96240ed915a814f, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:18.484810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:18.500120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1154/2295] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:18 2022] PUT /identity/v3/projects/f56218aa01a44bdab4d61c77052b01ff/users/9e5ca06ce6c54d79a96240ed915a814f/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:07:18.678179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:18.678859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:18.679486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:18.759522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:18.760853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:18.953995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1142/2296] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:07:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:19.024840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:19.029874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:19.267835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576a87-3dba-4125-92e1-873c0801b8b8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:19.286184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:19.288172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:19.288466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:19.288744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:19.331606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:19.333399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:19.354146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1155/2297] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:07:24.286795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:24.288383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:24.463117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e1ead-9006-40ab-80e7-fde90c139f14 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:24.479922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:24.480883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:24.481130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:24.481404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] PATH_INFO: `/v3/users/23977e96394d48f2b72a04d6905790c7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:24.482818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23977e96394d48f2b72a04d6905790c7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:24.489233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:24.649210 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23977e96394d48f2b72a04d6905790c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:24.650092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23977e96394d48f2b72a04d6905790c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:24.662778 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23977e96394d48f2b72a04d6905790c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:24.695992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23977e96394d48f2b72a04d6905790c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:24.706754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23977e96394d48f2b72a04d6905790c7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:24.720356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1143/2298] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:24 2022] DELETE /identity/v3/users/23977e96394d48f2b72a04d6905790c7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:25.072550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:25.110396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4c20c-2ab2-4e54-98cd-50cc1e4aa9d0 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:25.250691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:25.251857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:25.253356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:25.253836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] PATH_INFO: `/v3/projects/3708c7a8a8ca45b3b4e3e764b9b7f8fd` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:25.257263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3708c7a8a8ca45b3b4e3e764b9b7f8fd)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:25.259724 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:25.436066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3708c7a8a8ca45b3b4e3e764b9b7f8fd', 'request_id': 'req-41a97e3e-6037-487c-9e7f-3f880a81910c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.452074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3708c7a8a8ca45b3b4e3e764b9b7f8fd', 'request_id': 'req-41a97e3e-6037-487c-9e7f-3f880a81910c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.472588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3708c7a8a8ca45b3b4e3e764b9b7f8fd', 'request_id': 'req-41a97e3e-6037-487c-9e7f-3f880a81910c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.507191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] The token cache is being invalidate because project 3708c7a8a8ca45b3b4e3e764b9b7f8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:25.507782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.508683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.511029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1156/2299] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:25 2022] DELETE /identity/v3/projects/3708c7a8a8ca45b3b4e3e764b9b7f8fd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:25.514840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:25.518808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:25.539664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68740838-976a-4cd8-848f-6308a4e2b87d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:25.618705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:25.618705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:25.618705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:25.618705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] PATH_INFO: `/v3/users/b7187d673be84f3dace1d0aa497ff431` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:25.620057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7187d673be84f3dace1d0aa497ff431)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:25.622261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:25.862869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7187d673be84f3dace1d0aa497ff431'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.870496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7187d673be84f3dace1d0aa497ff431'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.911168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7187d673be84f3dace1d0aa497ff431'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.932311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7187d673be84f3dace1d0aa497ff431'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.950915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-5f36421a-80eb-416b-b174-227029eba405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7187d673be84f3dace1d0aa497ff431'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:25.964770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1144/2300] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:25 2022] DELETE /identity/v3/users/b7187d673be84f3dace1d0aa497ff431 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:26.472200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:26.473775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:26.489051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97e3e-6037-487c-9e7f-3f880a81910c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:26.580702 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:26.581241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:26.581429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:26.598801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:26.599716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:26.599986 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:26.600257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] PATH_INFO: `/v3/projects/4cbdf872d6654571904169fdc02602ea` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:26.603551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbdf872d6654571904169fdc02602ea)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:26.605487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:26.633338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] MFA Rules not processed for user `9e5ca06ce6c54d79a96240ed915a814f`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:26.633338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:26.707075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbdf872d6654571904169fdc02602ea', 'request_id': 'req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:26.720750 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbdf872d6654571904169fdc02602ea', 'request_id': 'req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:26.728435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbdf872d6654571904169fdc02602ea', 'request_id': 'req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:26.754611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] The token cache is being invalidate because project 4cbdf872d6654571904169fdc02602ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:26.755204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:26.756165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-22a9ac46-bc30-47cd-9ab8-316f3167e1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:26.758316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1157/2301] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:26 2022] DELETE /identity/v3/projects/4cbdf872d6654571904169fdc02602ea => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:26.767622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace58-1c91-4bca-aeee-57b480094c22 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:26.768389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace58-1c91-4bca-aeee-57b480094c22 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:26.769629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adace58-1c91-4bca-aeee-57b480094c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:26.774499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1145/2302] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:26.796114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:26.798603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:26.823519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1adace58-1c91-4bca-aeee-57b480094c22 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:26.826452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1adace58-1c91-4bca-aeee-57b480094c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:26.930886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1158/2303] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:26.934657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:26.935308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:26.935669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:26.946207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f29df-89a3-4fc6-b5f4-91d95011402f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:26.958536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:26.960527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:26.978704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1159/2304] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:07:26.981865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:26.994704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe912695-e989-44e3-9e7d-6af7c1790e2c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.001381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.002865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.002865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.003072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.004631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:07:27.004631 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.005942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.022884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1160/2305] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:07:27.027467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.041245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ed2a3-d8f7-4a79-b6a2-60d5dae09d7c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.044116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.045372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.045919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.046521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.049816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.050057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:27.050866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.051456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.051854 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.052964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.055739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.103585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1161/2306] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:07:27 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:27.108902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.153233 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.156350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.172206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1146/2307] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:27.264303 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef2f0-de8b-44bf-89eb-ec48ad46b24b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.271247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.273392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.282564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.283065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.284104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.287257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df8871-978e-44a2-965f-24a73aaf3932 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.344193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.346120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1162/2308] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:07:27 2022] POST /identity/v3/users => generated 281 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:27.365734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1f70d-e796-468f-95d5-1d1786d7b9c2 service glance] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.379645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.380557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.380849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.381178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.384433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.384727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.385005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.389891 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.392879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.411881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1147/2309] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:27.413870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.423685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:27.425207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:27.436993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464cb345-c9d3-4d3d-a82c-557ae424fbb5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.441789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.442533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.442902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.443244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.445245 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.454974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.465998 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1148/2310] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:27.472924 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.485225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee85a1-341f-4dc8-8fe3-b3184050176e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.498948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.500316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.500707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.501288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] PATH_INFO: `/v3/projects/1147020bf4534c9c999f887bc2f448f2/users/0ccadbcd5b3d407090b8066f72ab7c6f/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.511138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1163/2311] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:27.520643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1147020bf4534c9c999f887bc2f448f2, user_id=0ccadbcd5b3d407090b8066f72ab7c6f, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.529363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.530070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded6c0f-90c9-4556-9b0d-51f64887ae18 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.531276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:27.553585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1149/2312] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:27 2022] PUT /identity/v3/projects/1147020bf4534c9c999f887bc2f448f2/users/0ccadbcd5b3d407090b8066f72ab7c6f/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:27.564912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.565634 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.565901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.613084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] MFA Rules not processed for user `0ccadbcd5b3d407090b8066f72ab7c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:27.614850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:27.642972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305cb76-150e-4ec7-a86e-2ece32000e6c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.710728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1150/2313] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:27.727441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.730848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.730848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.730848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.740619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:27.742220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:27.808732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.810369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.821062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1164/2314] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:07:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 01 10:07:27.867718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb531565-7a18-4c37-adae-ff21e9464fad None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:27.876384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:27.877375 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:27.877737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:27.878094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:27.893744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:27.897701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaf440-b377-4d98-8b1d-ed0e37cb178e service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:27.912012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1151/2315] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:07:27.928100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:28.080812 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769faafb-0cec-47a8-ab14-c2f319a38570 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:28.098906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:28.100015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:28.100364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:28.100713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] PATH_INFO: `/v3/users/0ccadbcd5b3d407090b8066f72ab7c6f` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:28.105169 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccadbcd5b3d407090b8066f72ab7c6f)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:28.107266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:28.192266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccadbcd5b3d407090b8066f72ab7c6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:28.209430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccadbcd5b3d407090b8066f72ab7c6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:28.234093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccadbcd5b3d407090b8066f72ab7c6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:28.235012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccadbcd5b3d407090b8066f72ab7c6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:28.237565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccadbcd5b3d407090b8066f72ab7c6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:28.265277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1165/2316] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:27 2022] DELETE /identity/v3/users/0ccadbcd5b3d407090b8066f72ab7c6f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:28.271202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:28.272312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:28.272780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:28.313415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:28.316689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:28.521923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1152/2317] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:28.530469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:28.531925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:28.660336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71974186-5be0-4ebc-9c66-821135102001 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:28.663950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:28.664640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:28.664963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:28.665247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:28.687980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:28.689479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccf14d-33bf-4e3f-a669-b44ea8d2d4ad service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:28.716705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1166/2318] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:29.246791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:29.251157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:29.293085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb34c0-788a-424f-a71b-1744c52c9b85 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:29.305288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:29.307629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:29.308086 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:29.308518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] PATH_INFO: `/v3/projects/1147020bf4534c9c999f887bc2f448f2` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:29.311684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1147020bf4534c9c999f887bc2f448f2)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:29.319363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:29.472823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1147020bf4534c9c999f887bc2f448f2', 'request_id': 'req-267af0ee-2dad-42fe-a071-43b7fcc4a496'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:29.494236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1147020bf4534c9c999f887bc2f448f2', 'request_id': 'req-267af0ee-2dad-42fe-a071-43b7fcc4a496'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:29.509032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1147020bf4534c9c999f887bc2f448f2', 'request_id': 'req-267af0ee-2dad-42fe-a071-43b7fcc4a496'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:29.535875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] The token cache is being invalidate because project 1147020bf4534c9c999f887bc2f448f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:29.536877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:29.537784 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-267af0ee-2dad-42fe-a071-43b7fcc4a496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:29.544584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1153/2319] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:29 2022] DELETE /identity/v3/projects/1147020bf4534c9c999f887bc2f448f2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:29.549562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:29.550435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:29.550893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:29.588603 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:29.590178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:29.748066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1167/2320] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:29.751704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:29.755207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:29.755330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:29.816219 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:29.817517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:29.858302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1154/2321] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:07:29.863824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:29.883848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e748b80-e718-49c3-97f4-3c884750c22c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:29.897587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:29.901366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:29.901865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:29.902292 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:29.907390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:07:29.907958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:29.909783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:29.941453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1168/2322] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:07:29.942250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:29.963996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4768d4-0590-4c58-9d32-81ca90391b6f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:29.980185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:29.980862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:29.981147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:29.981430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:29.982226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:29.984079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.039304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1155/2323] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:07:29 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:07:30.043796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:30.060089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1df33-158b-41df-9ba4-faee5353b3ab admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:30.199463 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:30.200165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.200448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.200722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.201429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:30.209647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.260111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1169/2324] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:07:30 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:30.264002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:30.284974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f093f-9397-4509-aa52-3a73dd8e922e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:30.297267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:30.298154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.298538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.298943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.299797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:30.301624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.338956 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1156/2325] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:30.340226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:30.361035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0ec84-d8da-431e-aa8f-d17e78863ea6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:30.390079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:30.390995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.391444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.391871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.392757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:30.394900 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694ebd-a789-43ed-8bde-c65c37a703b1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.406878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1170/2326] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:07:30.411269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:30.435325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8715-846f-438b-830d-fdd2beec649e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:30.442169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:30.443273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.443647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.444023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] PATH_INFO: `/v3/projects/7734ad24518c4562a28353832aca4372/users/c2e23a0631ce4f5f82b80a6957c2b5a2/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.479578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7734ad24518c4562a28353832aca4372, user_id=c2e23a0631ce4f5f82b80a6957c2b5a2, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:30.482605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.529500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1157/2327] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:30 2022] PUT /identity/v3/projects/7734ad24518c4562a28353832aca4372/users/c2e23a0631ce4f5f82b80a6957c2b5a2/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:30.531181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.531538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.531947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.590487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] MFA Rules not processed for user `c2e23a0631ce4f5f82b80a6957c2b5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:30.593632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:30.734151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1171/2328] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:30.742995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:30.745401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:30.823945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1fe0f-d6d5-41c0-b50a-4eecf119418e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:30.827419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:30.828494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:30.828494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:30.828775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:30.839172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:30.843606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2376d0a-4bb2-478c-a1cf-127ddd83eea0 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:30.858107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1158/2329] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:07:33.949876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:34.049384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffceeac9-f72b-4cff-ba94-318a40bd08fc None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:34.057082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:34.058359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:34.058843 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:34.059268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] PATH_INFO: `/v3/users/c2e23a0631ce4f5f82b80a6957c2b5a2` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:34.064219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2e23a0631ce4f5f82b80a6957c2b5a2)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:34.072421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:34.311049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2e23a0631ce4f5f82b80a6957c2b5a2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:34.325988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2e23a0631ce4f5f82b80a6957c2b5a2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:34.400637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2e23a0631ce4f5f82b80a6957c2b5a2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:34.401407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2e23a0631ce4f5f82b80a6957c2b5a2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:34.402034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2e23a0631ce4f5f82b80a6957c2b5a2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:34.460068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:34.460631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:34.460631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:34.462456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1172/2330] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:33 2022] DELETE /identity/v3/users/c2e23a0631ce4f5f82b80a6957c2b5a2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:34.526146 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:34.536296 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:34.693391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1159/2331] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:34.701047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:34.702546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:34.786415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee16c8-4926-47c0-b944-1328901c055c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:34.791407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:34.792799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:34.792799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:34.793561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:34.804536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:34.806493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:34.817919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1173/2332] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:35.315676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:35.317388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:35.340450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4b1ad-ceda-4bc3-83fa-8a063c4dc612 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:35.349532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:35.351763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:35.352090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:35.352388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] PATH_INFO: `/v3/projects/7734ad24518c4562a28353832aca4372` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:35.353737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7734ad24518c4562a28353832aca4372)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:35.355899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:35.430788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7734ad24518c4562a28353832aca4372', 'request_id': 'req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:35.436599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7734ad24518c4562a28353832aca4372', 'request_id': 'req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:35.444601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7734ad24518c4562a28353832aca4372', 'request_id': 'req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:35.468627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] The token cache is being invalidate because project 7734ad24518c4562a28353832aca4372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:35.469799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:35.470017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7f1cb1ea-f17f-4a48-aa91-5302f16fd7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:35.483869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1160/2333] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:35 2022] DELETE /identity/v3/projects/7734ad24518c4562a28353832aca4372 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:38.758409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:38.760915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:38.774967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3650de9-11b2-4667-9712-727aac40c1b9 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:38.840050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:38.841361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:38.841962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:38.842444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:38.844747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:38.935653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:38.937927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c7d24-fd4d-4bd8-a992-b03e2597cbc0 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:38.949830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1174/2334] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:07:40.877547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:40.878876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:40.879412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:40.900936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] MFA Rules not processed for user `865b26ccfed74865b856e8c3d33e3574`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:40.902534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:40.973647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1161/2335] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:43.493371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a38d-16fb-47c5-9801-f78b95bbe77d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:43.493916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a38d-16fb-47c5-9801-f78b95bbe77d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:43.493916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4a38d-16fb-47c5-9801-f78b95bbe77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:43.512992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-50c4a38d-16fb-47c5-9801-f78b95bbe77d None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:43.514485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-50c4a38d-16fb-47c5-9801-f78b95bbe77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:43.580009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1175/2336] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:43.594292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:43.596402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:43.669217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d43ec-9ce8-45b1-8332-c027031195a6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:43.674673 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:43.675400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:43.675640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:43.675918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:43.702282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:43.702282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:43.707027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1162/2337] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:07:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:07:43.831332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:43.831709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:43.832048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:43.853797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:43.855337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:43.864530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1176/2338] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:07:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:43.896212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:43.917546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f876dc3-6ddc-4f73-96e2-c844714e98ad service swift] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:43.933850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:43.934964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:43.935755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:43.936294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:43.954453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:43.956548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:43.982335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1163/2339] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:07:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:07:46.261974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:46.263981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:46.335411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1dd41-92b9-440b-a460-851d96f14b72 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:46.340228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:46.341118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:46.341403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:46.341691 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] PATH_INFO: `/v3/users/b687f70831024cac87826377235bd5a6` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:46.342944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b687f70831024cac87826377235bd5a6)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:46.344873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:46.415187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b687f70831024cac87826377235bd5a6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.427597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b687f70831024cac87826377235bd5a6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.456612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b687f70831024cac87826377235bd5a6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.457364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b687f70831024cac87826377235bd5a6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.461208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3f84d437-e4e3-4d18-8a50-acedfb0f520e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b687f70831024cac87826377235bd5a6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.485961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1177/2340] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:07:46 2022] DELETE /identity/v3/users/b687f70831024cac87826377235bd5a6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:46.807943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:46.822922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930a443-10ad-492b-8090-207e9e29c2a7 service swift] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:46.900269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:46.901283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:46.901615 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:46.901967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] PATH_INFO: `/v3/projects/47d184624c1d4bae9384dc4be14343fd` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:46.904102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d184624c1d4bae9384dc4be14343fd)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:46.906922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:46.963320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d184624c1d4bae9384dc4be14343fd', 'request_id': 'req-6450517c-72db-45fd-960a-a6e03323ace4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.968336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d184624c1d4bae9384dc4be14343fd', 'request_id': 'req-6450517c-72db-45fd-960a-a6e03323ace4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.976111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d184624c1d4bae9384dc4be14343fd', 'request_id': 'req-6450517c-72db-45fd-960a-a6e03323ace4'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.991156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] The token cache is being invalidate because project 47d184624c1d4bae9384dc4be14343fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:07:46.991579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.992318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6450517c-72db-45fd-960a-a6e03323ace4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:07:46.998206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1164/2341] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:07:46 2022] DELETE /identity/v3/projects/47d184624c1d4bae9384dc4be14343fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:47.000718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.001000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.001347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.021375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:47.022590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:47.082004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1178/2342] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:47.090184 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.090454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.090768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.110013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:47.111260 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:47.119137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1165/2343] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:07:47.123433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.135171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e879f41-8133-4f60-9c53-ac8369559f7e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.139910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.140649 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.141057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.141336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.142072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:07:47.142379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.144395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.158693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1179/2344] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:07:47.162164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.172033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430bf5d-084e-4dea-a0fd-080f3a0f9da3 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.176661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.177329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.177612 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.177885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.178605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.180572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.209767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1166/2345] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:07:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:47.214058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.224122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78542f-2d29-45bd-9212-503487fb4bdf admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.277599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.278340 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.278564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.278852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.279544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.281464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.304555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1180/2346] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:07:47 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:07:47.309136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.319356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc56f0-e1e0-48e5-8a1f-39632d170eef admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.323919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.324590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.324875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.325158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.325885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.327548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.337928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1167/2347] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:47.342196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.353158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43824d-6157-41ea-8fe7-aff3b3d1aa08 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.358827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.359546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.359834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.360093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.360865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.362529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a338fb-50a8-4cb5-94d3-7b1dc306d60f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.373975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1181/2348] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:07:47.378301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.388803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb473d-c920-49f5-826e-2f2bcdf4bf6b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.394238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.395278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.395635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.395976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] PATH_INFO: `/v3/projects/fb14d2f362cf41338328bd33d5dd2c49/users/1c7ae414fb3e4476b6d74e8d08da30a2/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.411310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb14d2f362cf41338328bd33d5dd2c49, user_id=1c7ae414fb3e4476b6d74e8d08da30a2, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.414084 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.429704 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1168/2349] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:07:47 2022] PUT /identity/v3/projects/fb14d2f362cf41338328bd33d5dd2c49/users/1c7ae414fb3e4476b6d74e8d08da30a2/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:07:47.440910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.441522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.442198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.472460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] MFA Rules not processed for user `1c7ae414fb3e4476b6d74e8d08da30a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:07:47.473732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:47.555386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1182/2350] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:07:47.567241 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:07:47.569209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:07:47.629877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c27acf-9eb4-468a-a4e5-6e2242a3f65c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:07:47.633672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:07:47.634357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:07:47.634608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:07:47.634908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:07:47.643763 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:07:47.645534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a3417-61bd-4b05-8caf-c42b1d4ecef2 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:07:47.654622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1169/2351] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:07:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:21.554867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:21.556516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:21.613304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312af8b-6a91-4660-b937-e85295e3ae28 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:21.616977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:21.617626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:21.617907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:21.618175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:21.620133 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:21.686433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:21.687890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:21.697271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1183/2352] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:08:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:27.838754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:27.839319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:27.839319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:27.857567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:27.858810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:27.915740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1170/2353] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:08:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:08:27.938455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:27.939975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:28.012359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7cf35-b2ab-4b95-9b67-5a76d2103db1 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:28.017620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:28.018612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:28.018925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:28.019265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:28.027576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:28.029029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0980a-bf27-4e8f-9780-de7e5aa094dd service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:28.037286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1184/2354] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:08:39.657400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:39.734222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdac83-803d-4e87-9686-cb8a5196100f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:39.760977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:39.760977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:39.760977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:39.760977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] PATH_INFO: `/v3/users/1c7ae414fb3e4476b6d74e8d08da30a2` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:39.761648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7ae414fb3e4476b6d74e8d08da30a2)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:39.761648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:39.835371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7ae414fb3e4476b6d74e8d08da30a2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:39.836109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7ae414fb3e4476b6d74e8d08da30a2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:39.846285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7ae414fb3e4476b6d74e8d08da30a2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:39.863432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7ae414fb3e4476b6d74e8d08da30a2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:39.871864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7ae414fb3e4476b6d74e8d08da30a2'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:39.879583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1171/2355] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:08:39 2022] DELETE /identity/v3/users/1c7ae414fb3e4476b6d74e8d08da30a2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:08:39.884108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540631-411f-4e00-857f-ec198887184d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:39.884676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540631-411f-4e00-857f-ec198887184d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:39.884676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80540631-411f-4e00-857f-ec198887184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:39.922694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-80540631-411f-4e00-857f-ec198887184d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:39.922694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-80540631-411f-4e00-857f-ec198887184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:39.983201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1185/2356] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:08:39.992987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:39.994683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:40.055841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cfec-2a56-4304-81f5-05f6a13d0e62 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:40.062545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:40.063238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:40.063521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:40.063796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:40.073991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:40.075493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabd4e1-dfda-4259-a9e3-e5d02d5a4ba4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:40.085915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1172/2357] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:40.377591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80540631-411f-4e00-857f-ec198887184d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:40.379541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-80540631-411f-4e00-857f-ec198887184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:40.406558 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80540631-411f-4e00-857f-ec198887184d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:40.412792 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:40.414083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:40.414605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:40.416360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] PATH_INFO: `/v3/projects/fb14d2f362cf41338328bd33d5dd2c49` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:40.417931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb14d2f362cf41338328bd33d5dd2c49)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:40.420771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:40.491316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb14d2f362cf41338328bd33d5dd2c49', 'request_id': 'req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:40.501240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb14d2f362cf41338328bd33d5dd2c49', 'request_id': 'req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:40.508496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb14d2f362cf41338328bd33d5dd2c49', 'request_id': 'req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:40.537262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] The token cache is being invalidate because project fb14d2f362cf41338328bd33d5dd2c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:08:40.537262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:40.537262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-1948a6ee-3d0a-40ba-b2d5-8f902ba7581f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:08:40.537262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1186/2358] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:08:40 2022] DELETE /identity/v3/projects/fb14d2f362cf41338328bd33d5dd2c49 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:08:45.861208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:45.861834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:45.861834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:45.863757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1173/2359] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:08:45.869922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f9cd-b107-4368-b50d-d3b75eca8fee None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:45.870445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f9cd-b107-4368-b50d-d3b75eca8fee None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:45.870759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85f9cd-b107-4368-b50d-d3b75eca8fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:45.919952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2f85f9cd-b107-4368-b50d-d3b75eca8fee None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:45.921184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2f85f9cd-b107-4368-b50d-d3b75eca8fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:45.997205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1187/2360] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:08:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:08:46.009059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:46.010951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:46.077252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f68f0-99eb-4a70-be13-070eb9d4e108 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:46.081385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:46.082052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.082317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.082572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.093368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:46.094832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a43ecb-40bd-403f-a036-7dec1c3f1993 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:46.105510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1174/2361] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:46.188484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.188693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.188987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] PATH_INFO: `/` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.190881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1188/2362] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:08:46.196413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52207a8-bc47-43b5-b84d-285abca37352 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.196735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52207a8-bc47-43b5-b84d-285abca37352 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.197003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52207a8-bc47-43b5-b84d-285abca37352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.215846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-b52207a8-bc47-43b5-b84d-285abca37352 None None] MFA Rules not processed for user `2c8f234c44684cdfa836b64c3c87fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:46.217043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b52207a8-bc47-43b5-b84d-285abca37352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:46.277843 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1175/2363] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:08:46.292516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:46.294772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:46.310276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6c5bf-a888-428c-98d7-ba8e35d79288 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:46.314456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:46.315151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.315425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.315681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.322941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:46.324400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58baaed0-4f3f-4a23-b678-9074e7eb7514 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:46.332241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1189/2364] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:46.437580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40663b-ed11-471b-95f8-d0a9cde267b9 None None] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.437870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40663b-ed11-471b-95f8-d0a9cde267b9 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.439023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40663b-ed11-471b-95f8-d0a9cde267b9 None None] PATH_INFO: `/` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.440154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1176/2365] 10.222.0.46 () {54 vars in 921 bytes} [Fri Apr 1 10:08:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 01 10:08:46.447174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f399d-ed38-4228-ba4b-cfc5d24a1e9d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.447470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f399d-ed38-4228-ba4b-cfc5d24a1e9d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.447783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f399d-ed38-4228-ba4b-cfc5d24a1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.468195 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f09f399d-ed38-4228-ba4b-cfc5d24a1e9d None None] MFA Rules not processed for user `e04e4b6a2827449dbe36886a303f7a10`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:46.469412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f09f399d-ed38-4228-ba4b-cfc5d24a1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:46.479935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1190/2366] 10.222.0.46 () {58 vars in 1018 bytes} [Fri Apr 1 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:08:46.491003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40663b-ed11-471b-95f8-d0a9cde267b9 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:46.504037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40663b-ed11-471b-95f8-d0a9cde267b9 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:46.508295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:46.508929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:46.509206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:46.509472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:46.521563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:46.523031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:46.533695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1177/2367] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:08:48.913587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:48.914343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:48.914473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:48.942956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:08:48.944163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:49.004879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1191/2368] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:08:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:08:49.020992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:08:49.022820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:08:49.097812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b87275-b649-4bb9-9393-d4d285b42981 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:08:49.103965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:08:49.104613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:08:49.104915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:08:49.105222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:08:49.115202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:08:49.116814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:08:49.125167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1178/2369] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:09:02.623551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:02.633677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82be4a-8ca5-4ddb-82e4-c6b7281a5f56 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:02.638259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:02.638947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:02.639231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:02.639503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:02.642191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:02.656496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:02.657920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4f150-7b19-48c0-9e3e-b74c6edbf982 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:02.669391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1192/2370] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:09:02.977808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:02.979790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:03.037802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5737c6-ffc3-49e2-b497-1f0523f1d68e service swift] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:03.041717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:03.042368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:03.042732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:03.043011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:03.044909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:03.058370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:03.059806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:03.070410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1179/2371] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:09:15.492755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:15.493279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:15.493609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:15.512748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:09:15.514298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:15.522469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1193/2372] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:09:15.537194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:15.549389 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b55f3-bcc8-4c3a-a6a4-ab68d1949e39 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:15.556264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:15.556920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:15.557197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:15.557473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:15.566247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:15.567959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:15.576204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1180/2373] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:09:16.844395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:16.846223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:16.866337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417b23-4de3-4e2a-9646-2fe2534a3766 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:16.874822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:16.875475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:16.875761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:16.876031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:16.878081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:16.941486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:16.943156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2c635-45e3-40a9-8360-795e172ba0ae service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:16.952591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1194/2374] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:09:28.841839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:28.843570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:28.856479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afafaa-3b73-4fd4-a77f-cf15cac99ac0 service swift] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:28.860647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:28.861676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:28.861960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:28.862232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:28.864343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:28.874810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:28.876248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:28.884807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1181/2375] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:09:31.412519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:31.413065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:31.413065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:31.432899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] MFA Rules not processed for user `3ca94cdcf3824f56a886b757e41602dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:09:31.434108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:31.443501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1195/2376] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:09:36.483088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:36.484717 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:36.508601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4663a-d95e-489b-aa08-3f6cacd05b14 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:36.514227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:36.515029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:36.515315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:36.515592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:36.518209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:36.530402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:36.532023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:36.542278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1182/2377] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:09:39.354533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:09:39.369759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9933352-f75b-4719-b66b-1d27e9443c53 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:09:39.376976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:09:39.377647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:09:39.377941 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:09:39.378231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:09:39.380423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:09:39.451265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:09:39.452871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1adb80-36b9-4473-b8e4-d5f64341fb50 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:09:39.462414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1196/2378] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:09:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:10:24.356454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:10:24.368362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbd33d-ea22-432d-b709-b6809fd1b6a0 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:10:24.375547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:10:24.376191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:24.376473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:24.376752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:24.378785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:24.436898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:10:24.438519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:10:24.447677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1183/2379] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:10:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:10:33.207545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:33.208142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:33.208142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:33.227742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] MFA Rules not processed for user `a0661916b4064097a834dcef7e02b3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:10:33.229120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:33.236827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1197/2380] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:10:33.553294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:10:33.562978 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c0a63-ea47-47f8-b487-c18465dc8cc2 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:10:33.566974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:10:33.567617 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:33.567898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:33.568168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:33.570266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:33.579972 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:10:33.581380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:10:33.589517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1184/2381] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:10:33.921770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:10:33.923283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:33.990912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b96c6-287d-4f25-927c-d33bbf23f541 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:10:33.996037 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:10:33.996692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:33.996976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:33.997252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:33.999124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:34.010560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:10:34.013114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:10:34.024101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1198/2382] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:10:39.462334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:10:39.477152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36a29-682e-40be-82a6-25ca1219133c service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:10:39.483589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:10:39.484243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:39.484528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:39.484805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:39.486699 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:39.499597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:10:39.501244 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:10:39.512090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1185/2383] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:10:49.614680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:10:49.634361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aecf-5b8d-4a01-857f-af26f5d6a174 service placement] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:10:49.642331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:10:49.643421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:10:49.643775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:10:49.644687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:10:49.652641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:10:49.667074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:10:49.668714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b046e-a68e-41d1-87c3-bd015c2807b0 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:10:49.682283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1199/2384] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:00.613069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:00.623583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71c33-653a-48a4-b330-884e79c0ec59 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:00.632874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:00.633638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:00.633986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:00.634329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:00.636335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:00.698436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:00.699951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:00.710571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1186/2385] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:05.207743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.208487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.208487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.227536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:05.228954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:05.230605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] MFA Rules not processed for user `d6cc94b4e59c4b3ba507cc2e696e1a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:05.232019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:05.240695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e9f0-209d-4f61-a494-28903a9f1cbb service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:05.243535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1200/2386] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:05.245752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:05.246713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.247024 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.247299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] PATH_INFO: `/v3/users/3ca94cdcf3824f56a886b757e41602dd` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.248591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca94cdcf3824f56a886b757e41602dd)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:05.250720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:05.302090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca94cdcf3824f56a886b757e41602dd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.302943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca94cdcf3824f56a886b757e41602dd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.311363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca94cdcf3824f56a886b757e41602dd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.324051 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca94cdcf3824f56a886b757e41602dd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.330819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df631e46-a729-4746-8ad7-19c88aeb3048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca94cdcf3824f56a886b757e41602dd'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.336733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1187/2387] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:05 2022] DELETE /identity/v3/users/3ca94cdcf3824f56a886b757e41602dd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:11:05.508008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:05.519442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb65e8-a338-4b79-9b39-2031c677a687 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:05.586673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:05.587747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.587966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.588237 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] PATH_INFO: `/v3/projects/4073e831952c461bb6bb0e6b1137240b` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.589487 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4073e831952c461bb6bb0e6b1137240b)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:05.591417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:05.639277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4073e831952c461bb6bb0e6b1137240b', 'request_id': 'req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.644581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4073e831952c461bb6bb0e6b1137240b', 'request_id': 'req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.650605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4073e831952c461bb6bb0e6b1137240b', 'request_id': 'req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.664350 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] The token cache is being invalidate because project 4073e831952c461bb6bb0e6b1137240b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:05.664640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.665324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7ed3b8a4-3f40-43f7-9c2e-0fe5956bea6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:05.666932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1201/2388] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:05 2022] DELETE /identity/v3/projects/4073e831952c461bb6bb0e6b1137240b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:05.672089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.672398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.672679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.690914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:05.692187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:05.777483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1188/2389] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:05.785346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.785644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.785931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.805266 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:05.806488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:05.815923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1202/2390] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:05.820629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:05.831101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5fe7-12f9-4d8e-8e46-96100e99bb3c None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:05.836143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:05.836911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.837196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.837504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.838287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:05.838545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:05.840325 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:05.854899 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1189/2391] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:11:05.856944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:05.867787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c7eb1-7edd-47e8-af2d-15c3f45466b3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:05.873351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:05.874127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.874482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.874862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.875636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:05.877672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:05.920809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1203/2392] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:05 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:05.922696 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:05.933309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045259f-e0c8-4d4c-977f-47bae64a7ff9 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:05.989276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:05.989954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:05.990237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:05.990513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:05.991247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:05.993175 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.014390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1190/2393] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:05 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:11:06.018950 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.030709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d218-948b-49c8-908c-8f041b14b9af admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.035711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.036412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.036700 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.036977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.037717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.039442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.049938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1204/2394] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:06.054398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.064609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c3cfe-0399-4014-8970-5751ce5ca632 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.069488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.070187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.070465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.070775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.071508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.073100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcdd8a-5662-4119-bd02-cd7d9a9e1017 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.083098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1191/2395] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:06.087451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.098769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc412-d398-4e76-a45b-14125a73ca01 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.104114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.105101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.105386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.105663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] PATH_INFO: `/v3/projects/7565a205ccb54b7f9cf56359a9422394/users/8c65bd87f0fa49359c09f315391c0f6b/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.123480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7565a205ccb54b7f9cf56359a9422394, user_id=8c65bd87f0fa49359c09f315391c0f6b, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.126445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.143718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1205/2396] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:06 2022] PUT /identity/v3/projects/7565a205ccb54b7f9cf56359a9422394/users/8c65bd87f0fa49359c09f315391c0f6b/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:06.156526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.156818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.157094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.184400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] MFA Rules not processed for user `8c65bd87f0fa49359c09f315391c0f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:06.185647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:06.251838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1192/2397] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:06.257188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.319978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76853-5955-444e-a43d-3a9a0064ff58 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.325137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.325923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.326215 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.326632 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.327342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.329241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.355867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1206/2398] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:06.361373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.371913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640974de-e0bd-4afb-bca6-92e553e0318e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.429499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.430264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.430481 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.430834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.431649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.433549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.457106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1193/2399] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:06.462932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.476677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2cc16-90e5-4822-9ef2-ed7b04773216 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.484927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.485594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.485875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.486144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.486901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.488500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.499593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1207/2400] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:06.503906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.515441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf79ef4-0cd2-41d9-9856-54bfc9bb2f0e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.520600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.521267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.521549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.521830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.522559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.524194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88bd2e7-56fb-4dff-bc30-c701149314d0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.534160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1194/2401] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:06.538522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.548524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817dbb-3bf4-4240-9c8d-65d7b9b6a4e8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.553513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.554431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.554745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.555040 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] PATH_INFO: `/v3/projects/06956a53112e4b74be0ae28e295a9821/users/1fc977ff80e1405b85e85688c39d23ff/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.570780 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06956a53112e4b74be0ae28e295a9821, user_id=1fc977ff80e1405b85e85688c39d23ff, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.573881 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.597373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1208/2402] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:06 2022] PUT /identity/v3/projects/06956a53112e4b74be0ae28e295a9821/users/1fc977ff80e1405b85e85688c39d23ff/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:06.599580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.599878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.600162 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.630884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] MFA Rules not processed for user `1fc977ff80e1405b85e85688c39d23ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:06.632755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:06.697396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1195/2403] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:06.702349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.766173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0285a71-ddc0-4692-aa08-bbaedd83d3c1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.771501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.772252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.772555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.772817 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.773553 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.775557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.803239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1209/2404] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:06.807267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.820486 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5873c-41f7-4503-8983-a9e5faad4a00 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.878711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.879315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.879595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.879872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.880567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.882478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.908837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1196/2405] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:06 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:06.913462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.924679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900d46d-0e6c-4447-9dee-2a8325ed5ea2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.930491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.931234 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.931514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.931788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.932515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.934546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:06.945785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1210/2406] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:06.950318 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:06.962849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca1e5-94f3-4d34-b9c0-6858b9c57417 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:06.967719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:06.968659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:06.968942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:06.969213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] PATH_INFO: `/v3/projects/78e40491580249a895450d5fb95208c3/users/1b1eea5066f54ae2bdfaef2c6784af99/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:06.985530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e40491580249a895450d5fb95208c3, user_id=1b1eea5066f54ae2bdfaef2c6784af99, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:06.988422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:07.005919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1197/2407] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:06 2022] PUT /identity/v3/projects/78e40491580249a895450d5fb95208c3/users/1b1eea5066f54ae2bdfaef2c6784af99/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:07.011087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:07.023248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce34ba-c3d5-4389-88fa-1da5648e860e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:07.081139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:07.081809 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:07.082087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:07.082381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:07.083134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:07.084749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1ba76-e489-418b-b600-8f31c45259a3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:07.094440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1211/2408] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:07.098548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:07.108644 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34538cbe-0fcf-4794-803c-19968544b0a9 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:07.114042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:07.114966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:07.115237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:07.115505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] PATH_INFO: `/v3/projects/78e40491580249a895450d5fb95208c3/users/1b1eea5066f54ae2bdfaef2c6784af99/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:07.117490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e40491580249a895450d5fb95208c3, user_id=1b1eea5066f54ae2bdfaef2c6784af99, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:07.120424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:07.136282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1198/2409] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:07 2022] PUT /identity/v3/projects/78e40491580249a895450d5fb95208c3/users/1b1eea5066f54ae2bdfaef2c6784af99/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:07.146904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:07.147194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:07.147472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:07.173653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] MFA Rules not processed for user `1b1eea5066f54ae2bdfaef2c6784af99`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:07.175220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:07.243057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1212/2410] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:07.253786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:07.255786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:07.316812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60eb4f-5227-48f0-ba6d-87ce607a87bb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:07.321563 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:07.322237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:07.322521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:07.322824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:07.333252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:07.334953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:07.346096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1199/2411] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:07.391864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:07.394155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:07.407140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f88f-69ea-4290-b120-dad10f120779 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:07.412243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:07.413048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:07.413521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:07.413799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:07.481029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:07.482515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5a57f-ce7b-4e61-9081-c21798ba6718 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:07.494011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1213/2412] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:11:10.385238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:10.454533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b466c-cb3e-4fda-96d1-3b79693c67db service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:10.460328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:10.461206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:10.461461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:10.461753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] PATH_INFO: `/v3/users/8c65bd87f0fa49359c09f315391c0f6b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:10.463190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c65bd87f0fa49359c09f315391c0f6b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:10.465148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:10.515501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c65bd87f0fa49359c09f315391c0f6b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:10.516386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c65bd87f0fa49359c09f315391c0f6b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:10.524350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c65bd87f0fa49359c09f315391c0f6b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:10.536886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c65bd87f0fa49359c09f315391c0f6b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:10.544199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c65bd87f0fa49359c09f315391c0f6b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:10.550417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1200/2413] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:10 2022] DELETE /identity/v3/users/8c65bd87f0fa49359c09f315391c0f6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:10.555000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:10.555483 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:10.555580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:10.574349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:10.575629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:10.638851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1214/2414] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:10.648904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:10.650335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:10.706944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852be436-d013-4bb4-9588-706aaf6379ef admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:10.710938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:10.711589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:10.711873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:10.712149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:10.721720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:10.723205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:10.732562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1201/2415] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:11.003816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:11.005486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:11.020411 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bca3d-312f-412b-86d1-5c674e3503b0 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:11.025890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:11.026826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:11.027137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:11.027408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] PATH_INFO: `/v3/projects/7565a205ccb54b7f9cf56359a9422394` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:11.028905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7565a205ccb54b7f9cf56359a9422394)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:11.030952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:11.078246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7565a205ccb54b7f9cf56359a9422394', 'request_id': 'req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.084039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7565a205ccb54b7f9cf56359a9422394', 'request_id': 'req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.090530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7565a205ccb54b7f9cf56359a9422394', 'request_id': 'req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.105191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] The token cache is being invalidate because project 7565a205ccb54b7f9cf56359a9422394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:11.105479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.106129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.107799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1215/2416] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:11 2022] DELETE /identity/v3/projects/7565a205ccb54b7f9cf56359a9422394 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:11.112071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:11.122127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e4e0-a64e-41d2-a5f0-c5ffceb9cd2d service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:11.177394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:11.178248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:11.178549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:11.178850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] PATH_INFO: `/v3/users/1fc977ff80e1405b85e85688c39d23ff` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:11.180141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc977ff80e1405b85e85688c39d23ff)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:11.182122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:11.230568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc977ff80e1405b85e85688c39d23ff'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.231221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc977ff80e1405b85e85688c39d23ff'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.239769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc977ff80e1405b85e85688c39d23ff'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.251501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc977ff80e1405b85e85688c39d23ff'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.257886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc977ff80e1405b85e85688c39d23ff'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.263908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1202/2417] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:11 2022] DELETE /identity/v3/users/1fc977ff80e1405b85e85688c39d23ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:11.534141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:11.535735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:11.551588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb0007-11dc-4f9f-ae99-8dc51eb9c015 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:11.610689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:11.611472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:11.611752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:11.612061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] PATH_INFO: `/v3/projects/06956a53112e4b74be0ae28e295a9821` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:11.613242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] RBAC: Authorizing `identity:delete_project(project_id=06956a53112e4b74be0ae28e295a9821)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:11.616676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:11.666622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06956a53112e4b74be0ae28e295a9821', 'request_id': 'req-01113f50-3161-4430-9d8c-d1a6455baedd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.672259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06956a53112e4b74be0ae28e295a9821', 'request_id': 'req-01113f50-3161-4430-9d8c-d1a6455baedd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.678681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06956a53112e4b74be0ae28e295a9821', 'request_id': 'req-01113f50-3161-4430-9d8c-d1a6455baedd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.693454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] The token cache is being invalidate because project 06956a53112e4b74be0ae28e295a9821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:11.693819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.694514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.696417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1216/2418] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:11 2022] DELETE /identity/v3/projects/06956a53112e4b74be0ae28e295a9821 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:11.700223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:11.701652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:11.714479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ff1f7-cae7-49a7-ac94-4d64688bea87 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:11.786564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:11.788151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:11.788636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:11.788997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] PATH_INFO: `/v3/users/1b1eea5066f54ae2bdfaef2c6784af99` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:11.790335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1eea5066f54ae2bdfaef2c6784af99)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:11.792426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:11.843759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1eea5066f54ae2bdfaef2c6784af99'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.844413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1eea5066f54ae2bdfaef2c6784af99'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.852838 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1eea5066f54ae2bdfaef2c6784af99'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.864533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1eea5066f54ae2bdfaef2c6784af99'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.871105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f99a5cfb-8486-4ba9-b087-3999b6ad7f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1eea5066f54ae2bdfaef2c6784af99'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:11.877258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1203/2419] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:11 2022] DELETE /identity/v3/users/1b1eea5066f54ae2bdfaef2c6784af99 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:12.160590 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.162384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:12.176242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01113f50-3161-4430-9d8c-d1a6455baedd admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.233293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.234241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.234454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.234755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] PATH_INFO: `/v3/projects/78e40491580249a895450d5fb95208c3` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.235938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e40491580249a895450d5fb95208c3)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.237875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.289929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e40491580249a895450d5fb95208c3', 'request_id': 'req-6bacd440-0e27-4a52-bcff-0b39989c22e1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:12.296901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e40491580249a895450d5fb95208c3', 'request_id': 'req-6bacd440-0e27-4a52-bcff-0b39989c22e1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:12.304246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e40491580249a895450d5fb95208c3', 'request_id': 'req-6bacd440-0e27-4a52-bcff-0b39989c22e1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:12.319784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] The token cache is being invalidate because project 78e40491580249a895450d5fb95208c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:12.320368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:12.321044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6bacd440-0e27-4a52-bcff-0b39989c22e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:12.323075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1217/2420] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:12 2022] DELETE /identity/v3/projects/78e40491580249a895450d5fb95208c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:12.330214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.330505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.330819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.349666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:12.350912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:12.421881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1204/2421] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:12.430323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.431783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.432064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.454412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:12.455683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:12.465439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1218/2422] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:12.470154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.480159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b386d5-449c-4fca-b1b9-db17a8ebdc22 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.486119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.486812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.487147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.487363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.488094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:12.488409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.490045 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.501958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1205/2423] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:11:12.506692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.516228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca5a24-fe39-4f3f-b996-dbc569149100 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.521385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.522033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.522318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.522618 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.523335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.525240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.555210 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1219/2424] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:12.559637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.570285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2843-9ef0-4ea6-8027-d5e119eed58e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.625915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.626587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.626902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.627185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.627851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.629842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.651405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1206/2425] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:12.655789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.666371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e20c5-996f-40ee-abe8-52498e67df99 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.672486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.673114 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.673393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.673665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.674397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.676043 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.687488 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1220/2426] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:11:12.691475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.701510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbc6d6-5ec0-4f3f-8826-610d750d51dc admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.706639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.707397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.707640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.707945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.708638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.710243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e303-3fd9-4f03-832c-3a985952003a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.720075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1207/2427] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:12.724367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.735016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46dc6-e944-499c-9cf9-c72e612959e1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.740162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.741047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.741326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.741598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] PATH_INFO: `/v3/projects/514e50239831411bb44cfe532c8bd072/users/3c2a0e49898d48d0be186ebc3da36d26/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.756373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514e50239831411bb44cfe532c8bd072, user_id=3c2a0e49898d48d0be186ebc3da36d26, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.759044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.777616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1221/2428] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:12 2022] PUT /identity/v3/projects/514e50239831411bb44cfe532c8bd072/users/3c2a0e49898d48d0be186ebc3da36d26/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:12.791151 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43454197-8568-4743-ab08-5387c07b8674 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.791509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43454197-8568-4743-ab08-5387c07b8674 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.791787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43454197-8568-4743-ab08-5387c07b8674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.823057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-43454197-8568-4743-ab08-5387c07b8674 None None] MFA Rules not processed for user `3c2a0e49898d48d0be186ebc3da36d26`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:12.824284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-43454197-8568-4743-ab08-5387c07b8674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:12.888034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1208/2429] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:12.892906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:12.954325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06389e43-3128-4dff-9ce1-a8856e8d1679 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:12.962937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:12.963705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:12.964067 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:12.964400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:12.965128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:12.967628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:12.994182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1222/2430] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:12.998287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43454197-8568-4743-ab08-5387c07b8674 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.008892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43454197-8568-4743-ab08-5387c07b8674 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.064315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.064987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.065266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.065541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.066225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.068230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.089320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1209/2431] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:12 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:13.094270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.104987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26cbd5-bfb9-41b7-942f-fe2aab5481e6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.110412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.111111 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.111391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.111667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.112378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.113995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.125343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1223/2432] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:13.129679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.140148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29385d-de9a-49a7-8080-fcc6a9b015d9 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.145159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.146068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.146351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.146622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] PATH_INFO: `/v3/projects/d579f4d6c1a9431081fa1b7832eb6307/users/c9ad87ac798e45c5b023d7ee1f8d2ff3/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.161474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d579f4d6c1a9431081fa1b7832eb6307, user_id=c9ad87ac798e45c5b023d7ee1f8d2ff3, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.164133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.178994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1210/2433] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:13 2022] PUT /identity/v3/projects/d579f4d6c1a9431081fa1b7832eb6307/users/c9ad87ac798e45c5b023d7ee1f8d2ff3/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:13.183054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.192834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bbea5-925f-4e55-b768-e69378896ff6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.254740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.255361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.255652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.255932 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.256663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.258259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86577f65-8464-4e10-9d14-d5bb82138b3f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.268857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1224/2434] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:13.274150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.284996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7a6b8-6eb1-4352-a43d-5c890ce1f05a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.290431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.291360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.291639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.291914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] PATH_INFO: `/v3/projects/d579f4d6c1a9431081fa1b7832eb6307/users/c9ad87ac798e45c5b023d7ee1f8d2ff3/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.293999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d579f4d6c1a9431081fa1b7832eb6307, user_id=c9ad87ac798e45c5b023d7ee1f8d2ff3, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.297102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.307886 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1211/2435] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:13 2022] PUT /identity/v3/projects/d579f4d6c1a9431081fa1b7832eb6307/users/c9ad87ac798e45c5b023d7ee1f8d2ff3/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:13.318181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.318472 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.318807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.345962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] MFA Rules not processed for user `c9ad87ac798e45c5b023d7ee1f8d2ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:13.347192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:13.424259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1225/2436] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:13.436246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.438264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:13.502968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb731485-38c0-4d7e-b381-7d373501d472 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.507539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.508131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.508415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.508690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.518438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.519905 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.529368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1212/2437] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:11:13.641281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:13.650922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e020d1-d993-42a3-b7e0-07ed26df2692 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:13.654905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:13.655598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:13.655912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:13.656473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:13.713229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:13.714749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3aaafc-e6b9-48ab-8838-fe9ba30684b1 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:13.725000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1226/2438] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:18.583274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:18.683882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744057b7-d7c2-4b7a-9f44-ffbba613523e service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:18.688917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:18.689936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:18.690173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:18.690451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] PATH_INFO: `/v3/users/3c2a0e49898d48d0be186ebc3da36d26` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:18.703593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2a0e49898d48d0be186ebc3da36d26)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:18.706014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:18.759987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2a0e49898d48d0be186ebc3da36d26'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:18.760664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2a0e49898d48d0be186ebc3da36d26'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:18.772480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2a0e49898d48d0be186ebc3da36d26'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:18.785380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2a0e49898d48d0be186ebc3da36d26'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:18.792707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2a0e49898d48d0be186ebc3da36d26'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:18.799643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1213/2439] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:18 2022] DELETE /identity/v3/users/3c2a0e49898d48d0be186ebc3da36d26 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:18.804626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:18.805240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:18.805693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:18.826461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:18.828251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:18.889581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1227/2440] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:18.896608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:18.898378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:18.966306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79190a3-5b50-467d-a261-c8b588861532 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:18.974603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:18.977013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:18.977301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:18.977864 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:18.992488 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:18.993952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:19.004436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1214/2441] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:19.386512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:19.388107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:19.401187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecbd19-6296-4e27-ad13-069c26588f29 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:19.407949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:19.408829 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:19.409271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:19.409552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] PATH_INFO: `/v3/projects/514e50239831411bb44cfe532c8bd072` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:19.410842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514e50239831411bb44cfe532c8bd072)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:19.412969 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:19.464801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514e50239831411bb44cfe532c8bd072', 'request_id': 'req-6678e556-a62e-43ac-a6ba-426c7ac030a7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.472569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514e50239831411bb44cfe532c8bd072', 'request_id': 'req-6678e556-a62e-43ac-a6ba-426c7ac030a7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.479772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514e50239831411bb44cfe532c8bd072', 'request_id': 'req-6678e556-a62e-43ac-a6ba-426c7ac030a7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.500207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] The token cache is being invalidate because project 514e50239831411bb44cfe532c8bd072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:19.500642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.501328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.502936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1228/2442] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:19 2022] DELETE /identity/v3/projects/514e50239831411bb44cfe532c8bd072 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:19.507119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:19.520909 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2bf8c-dc4d-41e6-9849-d8358397396d service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:19.582261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:19.583181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:19.583467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:19.584015 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] PATH_INFO: `/v3/users/c9ad87ac798e45c5b023d7ee1f8d2ff3` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:19.585139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ad87ac798e45c5b023d7ee1f8d2ff3)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:19.587147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:19.646558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ad87ac798e45c5b023d7ee1f8d2ff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.647344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ad87ac798e45c5b023d7ee1f8d2ff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.657158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ad87ac798e45c5b023d7ee1f8d2ff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.670036 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ad87ac798e45c5b023d7ee1f8d2ff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.677253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-22326903-4835-4b79-a79c-161d5b2e36e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ad87ac798e45c5b023d7ee1f8d2ff3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:19.683627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1215/2443] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:19 2022] DELETE /identity/v3/users/c9ad87ac798e45c5b023d7ee1f8d2ff3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:19.971106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:19.972568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:19.991727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e556-a62e-43ac-a6ba-426c7ac030a7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.059651 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.060557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.060838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.061239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] PATH_INFO: `/v3/projects/d579f4d6c1a9431081fa1b7832eb6307` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.062367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d579f4d6c1a9431081fa1b7832eb6307)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.064339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.119347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd579f4d6c1a9431081fa1b7832eb6307', 'request_id': 'req-addbbc83-1ddf-4fc3-94a7-148e1545a464'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:20.126752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd579f4d6c1a9431081fa1b7832eb6307', 'request_id': 'req-addbbc83-1ddf-4fc3-94a7-148e1545a464'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:20.133502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd579f4d6c1a9431081fa1b7832eb6307', 'request_id': 'req-addbbc83-1ddf-4fc3-94a7-148e1545a464'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:20.147356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] The token cache is being invalidate because project d579f4d6c1a9431081fa1b7832eb6307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:20.147646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:20.151072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-addbbc83-1ddf-4fc3-94a7-148e1545a464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:20.152858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1229/2444] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:19 2022] DELETE /identity/v3/projects/d579f4d6c1a9431081fa1b7832eb6307 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:20.158150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.158432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.158736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.179894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:20.181337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:20.245733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1216/2445] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:20.253577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.253865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.254145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.273445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:20.274679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:20.283492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1230/2446] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:20.287716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.298311 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55859ec7-0828-4dce-80a5-3e63056bdc79 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.303328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.303897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.304141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.304647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.305382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:20.305694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.307398 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.319277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1217/2447] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:11:20.323744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.340725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c616-0285-4859-9ba9-e43b06abc140 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.345927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.346601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.346910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.347183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.347880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.349824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.377096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1231/2448] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:20.381348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.393218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155496-1d1d-4daa-a103-be73581dbef2 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.453288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.453982 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.454270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.454550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.455350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.457263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.483837 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1218/2449] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:20.487654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.502346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acdb96-0672-4aad-a892-e5084e3e95d3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.508589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.509264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.509547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.509818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.510557 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.512918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.527006 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1232/2450] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:20.529538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.544762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831608e1-99f8-45ab-bedc-047ee46b22d6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.550583 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.551386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.551710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.551990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.552823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.554557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c5c7-f515-4e51-9442-241e8f643c1f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.569955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1219/2451] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:20.573026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.594953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb3fba-65b0-4a2b-8338-7601747bd30c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.599972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.601070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.601514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.601794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] PATH_INFO: `/v3/projects/59c06a8c657b4093ad9e204dbc5a3d02/users/9aa4b15253014a43a6f3874ed86f6dfd/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.616873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c06a8c657b4093ad9e204dbc5a3d02, user_id=9aa4b15253014a43a6f3874ed86f6dfd, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.619608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.634419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1233/2452] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:20 2022] PUT /identity/v3/projects/59c06a8c657b4093ad9e204dbc5a3d02/users/9aa4b15253014a43a6f3874ed86f6dfd/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:20.645952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.646439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.646531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.672993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] MFA Rules not processed for user `9aa4b15253014a43a6f3874ed86f6dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:20.674236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:20.739587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1220/2453] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:20.744080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.806753 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b50bc-be81-4d8b-8e60-d5b0d8da3727 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.811759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.812970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.813228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.813505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.814239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.816390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.843715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1234/2454] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:20.848097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.861593 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aee09-7fde-489d-9f5f-97b84cea347a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.922451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.923207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.923492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.923773 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.924482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.926492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.949062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1221/2455] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:20 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:11:20.953332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.963758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649606e-ed29-4fb5-8194-2fa17498150f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:20.968645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:20.969308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:20.969594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:20.969872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:20.970605 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:20.972241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:20.982680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1235/2456] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:11:20.986715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:20.996740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9abee-f3a7-4baa-92e4-bc33627241e4 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:21.001859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:21.002791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.003088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.003360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] PATH_INFO: `/v3/projects/3ce479e200a744aa94f90089d052d077/users/01bf53fbfca64fd6b769b7f00b483635/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.018701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce479e200a744aa94f90089d052d077, user_id=01bf53fbfca64fd6b769b7f00b483635, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:21.021357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:21.038776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1222/2457] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:20 2022] PUT /identity/v3/projects/3ce479e200a744aa94f90089d052d077/users/01bf53fbfca64fd6b769b7f00b483635/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:11:21.042740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:21.053379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa59220-47e8-4e55-a676-6beea2642914 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:21.110748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:21.111367 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.111633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.111899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.112616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:21.114241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404816be-6ead-4c05-9a49-5e744aeb7dfa admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:21.124745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1236/2458] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:21.129098 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:21.141059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c636b1-ef9c-49bd-b1ad-89a4fecc20db admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:21.147321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:21.148234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.148516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.148786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] PATH_INFO: `/v3/projects/3ce479e200a744aa94f90089d052d077/users/01bf53fbfca64fd6b769b7f00b483635/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.150985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce479e200a744aa94f90089d052d077, user_id=01bf53fbfca64fd6b769b7f00b483635, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:21.153647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:21.165336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1223/2459] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:21 2022] PUT /identity/v3/projects/3ce479e200a744aa94f90089d052d077/users/01bf53fbfca64fd6b769b7f00b483635/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:21.176746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.177063 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.177391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.213445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] MFA Rules not processed for user `01bf53fbfca64fd6b769b7f00b483635`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:21.214685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:21.289521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1237/2460] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:21.300527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:21.302443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:21.360092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe483cd2-0ffe-4259-aaf2-00f51fc54aa6 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:21.364418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:21.365014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.365271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.365557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.376431 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:21.377878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d472b80-f397-4e9f-ace1-72eb21248676 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:21.392165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1224/2461] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:21.787773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:21.850245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ffa19-b2cc-4498-89ad-44505f37ccce None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:21.855934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:21.857056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.857347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.857620 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] PATH_INFO: `/v3/users/9aa4b15253014a43a6f3874ed86f6dfd` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.858869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa4b15253014a43a6f3874ed86f6dfd)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:21.860879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:21.912958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa4b15253014a43a6f3874ed86f6dfd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:21.921422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa4b15253014a43a6f3874ed86f6dfd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:21.933822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa4b15253014a43a6f3874ed86f6dfd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:21.934517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa4b15253014a43a6f3874ed86f6dfd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:21.935250 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa4b15253014a43a6f3874ed86f6dfd'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:21.947770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1238/2462] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:21 2022] DELETE /identity/v3/users/9aa4b15253014a43a6f3874ed86f6dfd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:21.952379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:21.952854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:21.952960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:21.970384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:21.971586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:22.030586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1225/2463] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:22.040775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:22.042636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:22.099734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3ec3a-dfb3-4e7a-8556-692d57f02655 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:22.103789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:22.104443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:22.104731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:22.105003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:22.114437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:22.115939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:22.125592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1239/2464] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:11:22.400336 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:22.401839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:22.415775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938705f-f680-4440-8e26-b850ad6293f1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:22.421604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:22.422500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:22.422812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:22.423088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] PATH_INFO: `/v3/projects/59c06a8c657b4093ad9e204dbc5a3d02` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:22.424411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c06a8c657b4093ad9e204dbc5a3d02)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:22.426374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:22.474737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c06a8c657b4093ad9e204dbc5a3d02', 'request_id': 'req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.480348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c06a8c657b4093ad9e204dbc5a3d02', 'request_id': 'req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.487149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c06a8c657b4093ad9e204dbc5a3d02', 'request_id': 'req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.502382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] The token cache is being invalidate because project 59c06a8c657b4093ad9e204dbc5a3d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:22.502707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.503401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.505097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1226/2465] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:22 2022] DELETE /identity/v3/projects/59c06a8c657b4093ad9e204dbc5a3d02 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:22.509270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:22.519820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821086e-6a3e-4b05-ab98-f8873fa7eec8 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:22.578497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:22.579415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:22.579684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:22.579967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] PATH_INFO: `/v3/users/01bf53fbfca64fd6b769b7f00b483635` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:22.581158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01bf53fbfca64fd6b769b7f00b483635)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:22.583140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:22.630601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01bf53fbfca64fd6b769b7f00b483635'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.639469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01bf53fbfca64fd6b769b7f00b483635'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.651883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01bf53fbfca64fd6b769b7f00b483635'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.652523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01bf53fbfca64fd6b769b7f00b483635'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.653153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2a1085ce-c669-482a-b610-e084b97f6626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01bf53fbfca64fd6b769b7f00b483635'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:22.665560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1240/2466] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:22 2022] DELETE /identity/v3/users/01bf53fbfca64fd6b769b7f00b483635 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:22.936209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:22.937988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:22.961273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad5d25-cfdc-4b4a-8cb0-322592ba34ed admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.019077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.019983 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.020264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.020538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] PATH_INFO: `/v3/projects/3ce479e200a744aa94f90089d052d077` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.021749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce479e200a744aa94f90089d052d077)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.023681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.072789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce479e200a744aa94f90089d052d077', 'request_id': 'req-21e3bc20-5107-43dc-a99b-10c5c037f5dc'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.078116 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce479e200a744aa94f90089d052d077', 'request_id': 'req-21e3bc20-5107-43dc-a99b-10c5c037f5dc'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.087327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce479e200a744aa94f90089d052d077', 'request_id': 'req-21e3bc20-5107-43dc-a99b-10c5c037f5dc'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.102316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] The token cache is being invalidate because project 3ce479e200a744aa94f90089d052d077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:23.102598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.103352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-21e3bc20-5107-43dc-a99b-10c5c037f5dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.105093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1227/2467] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:22 2022] DELETE /identity/v3/projects/3ce479e200a744aa94f90089d052d077 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:23.111465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.111949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.112069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.130493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:23.131727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:23.191729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1241/2468] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:23.201088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.201377 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.201652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.220783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:23.221969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:23.231384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1228/2469] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:23.235873 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.245931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f2263-316c-40fa-ac9d-5cab99ffec1a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.251774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.252429 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.252712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.252977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.253708 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:23.254012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.255747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.268082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1242/2470] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:11:23.272285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.281511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288f052-167a-4153-8b10-8ebefcddcffe None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.286319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.287000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.287286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.287562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.288268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.290197 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.318357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1229/2471] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:23.322802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.333375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6aeb-dccb-460d-8762-2c29249446d1 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.396642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.397339 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.397617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.397885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.398582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.400550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.422565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1243/2472] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:23.427350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.438559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a9790-e6a6-4eed-824a-c21d1975f6bc admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.443923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.444633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.444920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.445222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.445950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.447592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.458038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1230/2473] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:23.461973 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.472397 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6052-564a-4449-9c91-72f2a78cd7e7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.477551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.478247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.478529 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.478850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.479584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.481188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16432951-3d75-4d62-b7b8-05375a837865 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.491219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1244/2474] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:23.495552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.505646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7f4a-979b-4583-be5f-7fef9a911554 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.510633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.511539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.511820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.512093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] PATH_INFO: `/v3/projects/607598bff18743bd9afce28b0a6ba126/users/be7aac1757d74f2eb1a41e36fa6a60da/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.527303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607598bff18743bd9afce28b0a6ba126, user_id=be7aac1757d74f2eb1a41e36fa6a60da, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.529907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.545830 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1231/2475] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:23 2022] PUT /identity/v3/projects/607598bff18743bd9afce28b0a6ba126/users/be7aac1757d74f2eb1a41e36fa6a60da/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:23.556579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.556875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.557157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.584583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] MFA Rules not processed for user `be7aac1757d74f2eb1a41e36fa6a60da`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:23.585895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:23.652384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1245/2476] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:23.664660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.666619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:23.724246 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844086-e03d-4138-995c-cec96c8b2696 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.728510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.729171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.729453 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.729727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.738082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.739552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9068f-b86a-47b1-9fb0-1932ebc79151 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.748102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1232/2477] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:23.769212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:23.836993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3581-3342-4e9a-9463-4f70d432e687 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:23.843320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:23.844194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.844439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.844728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] PATH_INFO: `/v3/users/be7aac1757d74f2eb1a41e36fa6a60da` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.846163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7aac1757d74f2eb1a41e36fa6a60da)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:23.848157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:23.898107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7aac1757d74f2eb1a41e36fa6a60da'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.907060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7aac1757d74f2eb1a41e36fa6a60da'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.918433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7aac1757d74f2eb1a41e36fa6a60da'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.919146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7aac1757d74f2eb1a41e36fa6a60da'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.919810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7aac1757d74f2eb1a41e36fa6a60da'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:23.931874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1246/2478] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:23 2022] DELETE /identity/v3/users/be7aac1757d74f2eb1a41e36fa6a60da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:23.936795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:23.937122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:23.937403 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:23.956055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:23.957272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:24.018511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1233/2479] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:24.028388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:24.029913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:24.085826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f5c54-b8d1-4032-89e0-4ce1f0702cee admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:24.089876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:24.090332 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.090661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.091106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.102505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:24.104022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1428cc-d344-4b37-b96c-0cbbd526b151 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:24.114192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1247/2480] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:24.548678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:24.550214 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:24.566012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdae91-fac7-4080-aa2b-49ad5c8c09f7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:24.572174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:24.573097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.573381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.573654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] PATH_INFO: `/v3/projects/607598bff18743bd9afce28b0a6ba126` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.574903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607598bff18743bd9afce28b0a6ba126)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:24.576870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:24.656506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607598bff18743bd9afce28b0a6ba126', 'request_id': 'req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:24.661839 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607598bff18743bd9afce28b0a6ba126', 'request_id': 'req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:24.668107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607598bff18743bd9afce28b0a6ba126', 'request_id': 'req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:24.686942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] The token cache is being invalidate because project 607598bff18743bd9afce28b0a6ba126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:24.687232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:24.687859 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1fa75d86-1706-4fa4-8f3c-e53ff6bb3812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:24.689596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1234/2481] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:24 2022] DELETE /identity/v3/projects/607598bff18743bd9afce28b0a6ba126 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:24.694572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.694897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.695198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.713509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:24.714773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:24.776359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1248/2482] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:24.784372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.784662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.784943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.803976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:24.805548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:24.817655 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1235/2483] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:24.821928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:24.831617 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141ad04-a588-47c3-b431-0047a00454a8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:24.836690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:24.837357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.837652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.837930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.838727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:24.839059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:24.840678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:24.852103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1249/2484] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:11:24.856426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:24.865732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2755a9-4541-4e03-a705-a0aa49257ec4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:24.871046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:24.871720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.871999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.872268 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.872963 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:24.874907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:24.905932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1236/2485] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:24 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:24.910404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:24.921238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1695b-7c55-41d2-991b-9707ed2b0bb9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:24.981747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:24.982436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:24.982805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:24.983081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:24.983775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:24.985697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.008773 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1250/2486] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:24 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:25.013828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:25.025410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f75371-26a3-4c01-8ddf-46f0a39058eb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:25.035572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:25.036277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.036560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.037006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.037753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:25.039416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.050805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1237/2487] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:25.055021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:25.065264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e10cf-1bd7-4b61-b98b-e9d15bee21d0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:25.070508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:25.071216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.071508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.071784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.072519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:25.074152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae615c94-d66e-43ba-8adb-b84faddb9059 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.088582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1251/2488] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:25.093149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:25.103454 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38c56-161d-4e22-810a-c48cb73641ab admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:25.108440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:25.109391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.109678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.110016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] PATH_INFO: `/v3/projects/6374d011e9ad490ca38ae0fd039cd183/users/a22c2aa1290b4e808af57f2496303c48/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.125137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6374d011e9ad490ca38ae0fd039cd183, user_id=a22c2aa1290b4e808af57f2496303c48, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:25.127674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.142331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1238/2489] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:25 2022] PUT /identity/v3/projects/6374d011e9ad490ca38ae0fd039cd183/users/a22c2aa1290b4e808af57f2496303c48/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:25.153667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155330b-2879-48d6-8fc7-ea51af844487 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.154146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155330b-2879-48d6-8fc7-ea51af844487 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.154240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155330b-2879-48d6-8fc7-ea51af844487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.180442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f155330b-2879-48d6-8fc7-ea51af844487 None None] MFA Rules not processed for user `a22c2aa1290b4e808af57f2496303c48`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:25.181596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f155330b-2879-48d6-8fc7-ea51af844487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:25.255852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1252/2490] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:25.267412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:25.269499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:25.329581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e9958-8ed3-4d8f-b993-1166cde8ff45 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:25.334266 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:25.335021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.335299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.335572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.344247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:25.345793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.354531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1239/2491] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:25.508786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db94e7c-d6b6-40e4-8e85-612ba558ce1a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.509080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db94e7c-d6b6-40e4-8e85-612ba558ce1a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.509355 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db94e7c-d6b6-40e4-8e85-612ba558ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.528418 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6db94e7c-d6b6-40e4-8e85-612ba558ce1a None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:25.529641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6db94e7c-d6b6-40e4-8e85-612ba558ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:25.588915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1253/2492] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:25.647068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:25.648577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:25.726540 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b7499-c903-41d7-bacf-7aed106f3fd3 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:25.735090 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:25.736122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:25.736406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:25.736677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:25.745391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:25.747073 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:25.755641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1240/2493] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:26.704647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:26.705186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:26.705284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:26.723793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] MFA Rules not processed for user `a22c2aa1290b4e808af57f2496303c48`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:26.725005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:26.732794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1254/2494] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:34.760352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:34.762506 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:34.830755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc29fe-b816-4e9d-b9b4-15ba52c9f039 service swift] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:34.835225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:34.836107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:34.836390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:34.836664 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] PATH_INFO: `/v3/users/865b26ccfed74865b856e8c3d33e3574` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:34.837842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865b26ccfed74865b856e8c3d33e3574)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:34.839858 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:34.886379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865b26ccfed74865b856e8c3d33e3574'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:34.887038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865b26ccfed74865b856e8c3d33e3574'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:34.896141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865b26ccfed74865b856e8c3d33e3574'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:34.907415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865b26ccfed74865b856e8c3d33e3574'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:34.913831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865b26ccfed74865b856e8c3d33e3574'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:34.919588 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1241/2495] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:34 2022] DELETE /identity/v3/users/865b26ccfed74865b856e8c3d33e3574 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:35.086790 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:35.099532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ea3e8-3d7b-4095-8b92-ec095f3c0ff3 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:35.161329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:35.162194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:35.162489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:35.162820 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] PATH_INFO: `/v3/projects/c4a61874308747efa6cf0456be5f46b6` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:35.164025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a61874308747efa6cf0456be5f46b6)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:35.165927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:35.213580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a61874308747efa6cf0456be5f46b6', 'request_id': 'req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.219160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a61874308747efa6cf0456be5f46b6', 'request_id': 'req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.225447 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a61874308747efa6cf0456be5f46b6', 'request_id': 'req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.241054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] The token cache is being invalidate because project c4a61874308747efa6cf0456be5f46b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:35.241338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.241990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.243710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1255/2496] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:35 2022] DELETE /identity/v3/projects/c4a61874308747efa6cf0456be5f46b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:35.248127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:35.249584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:35.263218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5f775-682b-4b7f-bf40-f4e8925ba651 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:35.324254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:35.325564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:35.326031 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:35.326472 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] PATH_INFO: `/v3/users/9e5ca06ce6c54d79a96240ed915a814f` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:35.328578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5ca06ce6c54d79a96240ed915a814f)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:35.330892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:35.382161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5ca06ce6c54d79a96240ed915a814f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.382910 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5ca06ce6c54d79a96240ed915a814f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.392779 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5ca06ce6c54d79a96240ed915a814f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.404182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5ca06ce6c54d79a96240ed915a814f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.410724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1f6c3ff3-7ec7-47b9-9569-7af282357a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5ca06ce6c54d79a96240ed915a814f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.416374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1242/2497] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:35 2022] DELETE /identity/v3/users/9e5ca06ce6c54d79a96240ed915a814f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:35.595356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:35.597311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:35.612930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c2cb-d20e-49b1-9000-a30bf3a69ddf admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:35.669920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:35.670833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:35.671125 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:35.671404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] PATH_INFO: `/v3/projects/f56218aa01a44bdab4d61c77052b01ff` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:35.672610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56218aa01a44bdab4d61c77052b01ff)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:35.674556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:35.724771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56218aa01a44bdab4d61c77052b01ff', 'request_id': 'req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.731527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56218aa01a44bdab4d61c77052b01ff', 'request_id': 'req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.737939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56218aa01a44bdab4d61c77052b01ff', 'request_id': 'req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.752374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] The token cache is being invalidate because project f56218aa01a44bdab4d61c77052b01ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:35.752637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.753396 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:35.755022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1256/2498] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:35 2022] DELETE /identity/v3/projects/f56218aa01a44bdab4d61c77052b01ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:44.744252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddca-dfe8-482a-8a16-567dba7f9950 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:44.744700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddca-dfe8-482a-8a16-567dba7f9950 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:44.744800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddca-dfe8-482a-8a16-567dba7f9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:44.764272 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-6dc2ddca-dfe8-482a-8a16-567dba7f9950 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:44.765448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6dc2ddca-dfe8-482a-8a16-567dba7f9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:44.818988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1243/2499] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:44.831410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:44.832916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:44.902968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279f5d4-a6d4-4555-8d4a-adfa9f7a542c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:44.908954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:44.909593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:44.909876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:44.910146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:44.918359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:44.919967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:44.927938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1257/2500] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:11:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:45.452719 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eba3a-4ddb-407e-a653-630bf50c5447 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:45.453039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eba3a-4ddb-407e-a653-630bf50c5447 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:45.453324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472eba3a-4ddb-407e-a653-630bf50c5447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:45.472444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-472eba3a-4ddb-407e-a653-630bf50c5447 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:45.473660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-472eba3a-4ddb-407e-a653-630bf50c5447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:45.481848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1244/2501] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:45.494298 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:45.505059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fee98-d99b-4364-8b95-5f505af17923 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:45.510423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:45.511117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:45.511403 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:45.511684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:45.520430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:45.522023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:45.530107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1258/2502] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:11:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:45.727443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4307-fb52-424f-8945-d84107902b84 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:45.727733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4307-fb52-424f-8945-d84107902b84 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:45.728005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db4307-fb52-424f-8945-d84107902b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:45.746631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-57db4307-fb52-424f-8945-d84107902b84 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:45.747853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-57db4307-fb52-424f-8945-d84107902b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:45.756119 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1245/2503] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:45.768883 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:45.779852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd79d2-7a21-4661-b152-b507ec11b1c2 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:45.786356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:45.786978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:45.787270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:45.787541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:45.796462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:45.798055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:45.806384 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1259/2504] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:11:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:46.128958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:46.129234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:46.129510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:46.148518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:46.149723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:46.158439 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1246/2505] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:46.171180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:46.182229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75d957-c9fa-44c6-a4c8-c052ce335ac8 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:46.188596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:46.189240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:46.189527 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:46.189913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:46.198512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:46.200158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3780aa-08b6-465b-807e-a4eded73f8f8 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:46.208556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1260/2506] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:11:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:48.277339 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:48.278988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:48.356589 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ecf8a-ca71-4906-b06d-6039aac96429 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:48.361817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:48.362681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:48.362999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:48.363271 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] PATH_INFO: `/v3/users/a22c2aa1290b4e808af57f2496303c48` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:48.364507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22c2aa1290b4e808af57f2496303c48)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:48.366469 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:48.421530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22c2aa1290b4e808af57f2496303c48'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.422211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22c2aa1290b4e808af57f2496303c48'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.431522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22c2aa1290b4e808af57f2496303c48'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.442966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22c2aa1290b4e808af57f2496303c48'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.450370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22c2aa1290b4e808af57f2496303c48'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.456641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1247/2507] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:11:48 2022] DELETE /identity/v3/users/a22c2aa1290b4e808af57f2496303c48 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:48.461524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:48.462025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:48.462025 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:48.480265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:48.481459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:48.539952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1261/2508] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:48.549929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:48.551652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:48.611753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74828e-ca6f-4443-93a0-7855894bde2e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:48.624320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:48.624465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:48.624703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:48.624981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:48.635005 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:48.636456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a308a-28a0-47f0-bbc4-c1073cea813a service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:48.646688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1248/2509] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:48.837317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:48.838768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:48.852044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0f114-5c92-4c7b-b5c4-702e3eed8255 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:48.857378 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:48.858278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:48.858540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:48.858862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] PATH_INFO: `/v3/projects/6374d011e9ad490ca38ae0fd039cd183` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:48.860158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6374d011e9ad490ca38ae0fd039cd183)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:48.862220 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:48.916788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6374d011e9ad490ca38ae0fd039cd183', 'request_id': 'req-5c97673b-7943-4e09-8301-5b137a6deb5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.924948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6374d011e9ad490ca38ae0fd039cd183', 'request_id': 'req-5c97673b-7943-4e09-8301-5b137a6deb5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.932201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6374d011e9ad490ca38ae0fd039cd183', 'request_id': 'req-5c97673b-7943-4e09-8301-5b137a6deb5d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.946588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] The token cache is being invalidate because project 6374d011e9ad490ca38ae0fd039cd183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:11:48.946912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.947596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5c97673b-7943-4e09-8301-5b137a6deb5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:11:48.949239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1262/2510] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:11:48 2022] DELETE /identity/v3/projects/6374d011e9ad490ca38ae0fd039cd183 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:48.954378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:48.954668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:48.954989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:48.974681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:48.975993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:49.039425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1249/2511] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:49.047943 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.048227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.048503 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.067079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:49.068259 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:49.076633 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1263/2512] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:49.080880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.091113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0cfa8-31da-4826-ac23-0b04caa4c660 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.096992 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.097652 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.097932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.098202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.098962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:11:49.099236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.101006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.113201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1250/2513] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:11:49.117693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.127433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b1fd-4ca2-4c41-a09b-158d7f524062 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.133619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.134275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.134555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.134865 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.135588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.137885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.167310 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1264/2514] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:11:49 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:11:49.171695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.182133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfd19d-eae9-4743-94be-1b06a9423f3f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.241379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.242040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.242323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.242622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.243343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.245261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.270113 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1251/2515] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:11:49 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:11:49.271493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.281796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5ecf-fd40-4e66-97c1-bb6f8f51f4fb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.286714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.287379 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.287718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.287992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.288719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.290361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.300909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1265/2516] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:11:49.305277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.315732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a3b35-c9d9-46dc-b2e5-4b65f6ee27bb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.320860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.321558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.321840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.322115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.322932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.324561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e116dd-b42b-4283-8cf4-edbfd1d8d29b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.334492 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1252/2517] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:11:49.338694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.348867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e23639-794b-4d33-98b8-6219ba7c195e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.354057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.354983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.355265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.355514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] PATH_INFO: `/v3/projects/bbdc40573f43486bb7c7a2fc5f262033/users/ac87a6bd2eef40c58f71e7a787e18651/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.370904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdc40573f43486bb7c7a2fc5f262033, user_id=ac87a6bd2eef40c58f71e7a787e18651, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.373549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.389353 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1266/2518] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:11:49 2022] PUT /identity/v3/projects/bbdc40573f43486bb7c7a2fc5f262033/users/ac87a6bd2eef40c58f71e7a787e18651/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:11:49.394555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc933d-cbf3-4d57-a250-8af6125793c0 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.394877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc933d-cbf3-4d57-a250-8af6125793c0 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.395157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc933d-cbf3-4d57-a250-8af6125793c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.413220 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e2fc933d-cbf3-4d57-a250-8af6125793c0 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:49.414420 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e2fc933d-cbf3-4d57-a250-8af6125793c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:49.474438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1253/2519] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:11:49.484768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:49.486816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:49.544265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69aad-c112-4d61-947c-e68f82dfb58c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:49.548283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:49.548985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:49.549262 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:49.549532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:49.559365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:49.560796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:49.570980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1267/2520] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:50.177680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf396-351a-4f61-a0b9-644231c018ef None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:50.177975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf396-351a-4f61-a0b9-644231c018ef None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:50.178254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf396-351a-4f61-a0b9-644231c018ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:50.204708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-03baf396-351a-4f61-a0b9-644231c018ef None None] MFA Rules not processed for user `ac87a6bd2eef40c58f71e7a787e18651`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:50.205923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-03baf396-351a-4f61-a0b9-644231c018ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:50.271142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1254/2521] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:11:50.282341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:11:50.283835 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:50.339216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1190c30-42aa-467f-b3c8-d399b5aabb20 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:11:50.343162 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:11:50.343869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:50.344080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:50.344329 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:50.353233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:11:50.354723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:11:50.363456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1268/2522] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:11:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:11:51.721281 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:11:51.721818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:11:51.721818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:11:51.741945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] MFA Rules not processed for user `ac87a6bd2eef40c58f71e7a787e18651`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:11:51.743304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:11:51.751480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1255/2523] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:12:13.312731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:13.314311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:13.391306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ade10e-e837-4ed9-9b58-03e5010e0bf3 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:13.404897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:13.405840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:13.406224 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:13.406612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:13.409798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:13.425271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:13.427921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43407b-9528-4dd3-abc9-139cbf6139d8 service placement] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:13.443635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1269/2524] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:12:32.030929 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:32.041793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a1e84-0e62-4f75-8a79-8bc0bb7faa37 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:32.046217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:32.046907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:32.047193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:32.047477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:32.049350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:32.106240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:32.107680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:32.116832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1256/2525] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:12:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:12:36.942722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:36.943252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:36.943730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:36.962850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:12:36.964047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:37.020886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1270/2526] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:12:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:12:37.042914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:37.044415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:37.115687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc24a8-2a87-44fa-9d23-425c905702e4 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:37.120745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:37.121390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:37.121669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:37.121940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:37.130148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:37.137544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6222eab-7972-462b-ba8e-2c2837c18060 service swift] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:37.146252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1257/2527] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:12:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:12:48.736848 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:48.738358 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:48.749884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fd4bb-cd74-4c65-9311-9411ac401bbf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:48.753678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:48.754316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:48.754595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:48.754909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:48.757032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:48.770226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:48.771704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:48.781533 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1271/2528] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:12:54.191000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:54.191551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:54.191987 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:54.214954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:12:54.216154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:54.223614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1258/2529] 10.222.0.46 () {58 vars in 1009 bytes} [Fri Apr 1 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:12:54.235858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:54.248154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae95258-0969-487c-90db-90e4d1ecf9df service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:54.260898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:54.261575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:54.261892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:54.262198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:54.271453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:54.273311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:54.295235 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1272/2530] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:12:56.542077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:56.543674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:56.575400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ebda8-d54a-47d7-92c4-e9e2702d8de5 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:56.580138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:56.581118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:56.581423 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:56.581698 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] PATH_INFO: `/v3/users/7e73b5e40fca4a40b235f934b7573f22` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:56.582985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e73b5e40fca4a40b235f934b7573f22)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:56.584917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:56.663720 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e73b5e40fca4a40b235f934b7573f22'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:56.665688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e73b5e40fca4a40b235f934b7573f22'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:56.679726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e73b5e40fca4a40b235f934b7573f22'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:56.710056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e73b5e40fca4a40b235f934b7573f22'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:56.729502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e73b5e40fca4a40b235f934b7573f22'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:56.746883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1259/2531] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:12:56 2022] DELETE /identity/v3/users/7e73b5e40fca4a40b235f934b7573f22 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:12:56.972451 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:56.983445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061930a-5cd6-4a51-a989-27175005af37 service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:57.059039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:57.059911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:57.060494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:57.060729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] PATH_INFO: `/v3/projects/3dc1f10cbf10469d8abe0641ae154834` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:57.061983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc1f10cbf10469d8abe0641ae154834)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:57.063897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:57.112470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc1f10cbf10469d8abe0641ae154834', 'request_id': 'req-f6dd762b-3239-4574-98f7-c371e9368db0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.117562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc1f10cbf10469d8abe0641ae154834', 'request_id': 'req-f6dd762b-3239-4574-98f7-c371e9368db0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.125241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc1f10cbf10469d8abe0641ae154834', 'request_id': 'req-f6dd762b-3239-4574-98f7-c371e9368db0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.139021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] The token cache is being invalidate because project 3dc1f10cbf10469d8abe0641ae154834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:12:57.139372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.139955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.141768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1273/2532] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:12:56 2022] DELETE /identity/v3/projects/3dc1f10cbf10469d8abe0641ae154834 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:12:57.145912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:57.147384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:57.160694 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee247b-f6ce-4604-8e0f-6dc1e29f9a7e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:57.220731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:57.221628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:57.221913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:57.222186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] PATH_INFO: `/v3/users/552dc2cdabb647d795ec3033af3f1843` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:57.223528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] RBAC: Authorizing `identity:delete_user(user_id=552dc2cdabb647d795ec3033af3f1843)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:57.225614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:57.279641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '552dc2cdabb647d795ec3033af3f1843'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.280309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '552dc2cdabb647d795ec3033af3f1843'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.289504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '552dc2cdabb647d795ec3033af3f1843'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.302317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '552dc2cdabb647d795ec3033af3f1843'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.309029 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-c6a56723-1aeb-45c3-9445-ceff5f04885f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '552dc2cdabb647d795ec3033af3f1843'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.315174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1260/2533] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:12:57 2022] DELETE /identity/v3/users/552dc2cdabb647d795ec3033af3f1843 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:12:57.508053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:12:57.509491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:12:57.529335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd762b-3239-4574-98f7-c371e9368db0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:12:57.599046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:12:57.600156 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:12:57.600434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:12:57.600703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] PATH_INFO: `/v3/projects/0a77e47eee1d494b98efc955d69e3299` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:12:57.601867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a77e47eee1d494b98efc955d69e3299)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:12:57.603791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:12:57.668625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a77e47eee1d494b98efc955d69e3299', 'request_id': 'req-21a9f092-e00c-4180-a495-2c9634e14876'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.674949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a77e47eee1d494b98efc955d69e3299', 'request_id': 'req-21a9f092-e00c-4180-a495-2c9634e14876'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.684106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a77e47eee1d494b98efc955d69e3299', 'request_id': 'req-21a9f092-e00c-4180-a495-2c9634e14876'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.710099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] The token cache is being invalidate because project 0a77e47eee1d494b98efc955d69e3299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:12:57.710502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.711400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:12:57.727187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1274/2534] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:12:57 2022] DELETE /identity/v3/projects/0a77e47eee1d494b98efc955d69e3299 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:13:21.777679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647997-0c92-4b3f-a70a-0ad82c87e568 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:21.778274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647997-0c92-4b3f-a70a-0ad82c87e568 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:21.778274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7647997-0c92-4b3f-a70a-0ad82c87e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:21.797798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c7647997-0c92-4b3f-a70a-0ad82c87e568 None None] MFA Rules not processed for user `ac87a6bd2eef40c58f71e7a787e18651`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:13:21.799032 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c7647997-0c92-4b3f-a70a-0ad82c87e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:21.864931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1261/2535] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:13:22.104072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:22.105637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:22.168007 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9f092-e00c-4180-a495-2c9634e14876 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:22.171944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:22.172607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:22.172891 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:22.173165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:22.175124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:22.184927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:22.186482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:22.194541 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1275/2536] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:13:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:13:22.239552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:22.240183 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:22.240825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:22.264445 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] MFA Rules not processed for user `943154c0b9094ad79191f37028e30f73`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:13:22.265726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:22.327632 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1262/2537] 10.222.0.46 () {58 vars in 967 bytes} [Fri Apr 1 10:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:13:22.340191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:22.342498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:22.417199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca219f-07b9-41e0-97cf-9b24386c6ccd service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:22.424321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b5af1ed1a34c219c29b23c6ee49ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:22.425001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:22.425289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:22.425565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:22.435107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:22.436735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:22.445317 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1276/2538] 10.222.0.46 () {60 vars in 1384 bytes} [Fri Apr 1 10:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:52.154942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:52.156508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:52.168970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7623e65-be2c-429c-9dec-663334dda3f8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:52.173117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:52.173764 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:52.174048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:52.174320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:52.176207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:52.238341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:52.239793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:52.249637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1263/2539] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:13:55.662984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:55.664672 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:55.681542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e546e-a457-4f75-bea0-c73e5782e74e service swift] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:55.687074 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:55.687980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:55.688258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:55.688536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] PATH_INFO: `/v3/users/d6cc94b4e59c4b3ba507cc2e696e1a37` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:55.689759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cc94b4e59c4b3ba507cc2e696e1a37)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:55.691796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:55.759149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cc94b4e59c4b3ba507cc2e696e1a37'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:55.768597 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cc94b4e59c4b3ba507cc2e696e1a37'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:55.784616 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cc94b4e59c4b3ba507cc2e696e1a37'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:55.785442 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cc94b4e59c4b3ba507cc2e696e1a37'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:55.786059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b9f0406f-9108-4bac-91ae-420f2eaf95e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cc94b4e59c4b3ba507cc2e696e1a37'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:55.798871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1277/2540] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:13:55 2022] DELETE /identity/v3/users/d6cc94b4e59c4b3ba507cc2e696e1a37 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:13:55.982010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:55.992528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879d9e-ba7c-423b-ac11-7a9dd87f9083 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.059840 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.060669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.060961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.061232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] PATH_INFO: `/v3/projects/8abd12555c7642749049eaaedec0cbc1` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.062531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abd12555c7642749049eaaedec0cbc1)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.064555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.116916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abd12555c7642749049eaaedec0cbc1', 'request_id': 'req-06c47f63-ddbe-4d09-8aea-fb6653272113'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:56.123505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abd12555c7642749049eaaedec0cbc1', 'request_id': 'req-06c47f63-ddbe-4d09-8aea-fb6653272113'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:56.130111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abd12555c7642749049eaaedec0cbc1', 'request_id': 'req-06c47f63-ddbe-4d09-8aea-fb6653272113'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:56.148123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] The token cache is being invalidate because project 8abd12555c7642749049eaaedec0cbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:13:56.149666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:56.149666 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-06c47f63-ddbe-4d09-8aea-fb6653272113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:13:56.150640 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1264/2541] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:13:55 2022] DELETE /identity/v3/projects/8abd12555c7642749049eaaedec0cbc1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:13:56.155786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.156081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.156346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.174998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:13:56.176333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:56.236852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1278/2542] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:13:56.244367 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.244851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.245154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.264541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:13:56.265753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:56.273802 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1265/2543] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:13:56.278213 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.287872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c9cba-3f8c-477f-bda9-a47048b4a20d None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.292687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.293164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.293410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.293680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.294407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:13:56.294743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.296435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.309432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1279/2544] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:13:56.313744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.323164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026e3c-a2ef-4e6a-ba8a-1e583cae0870 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.327677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.328341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.328629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.328904 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.329627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.331578 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.358690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1266/2545] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:13:56 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:13:56.361103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.371110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758d2dd-24d8-49bd-859f-ae0019ae9d07 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.437520 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.438198 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.438485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.438798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.439491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.441410 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.462060 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1280/2546] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:13:56 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:13:56.468870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.476961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83827a-c1d9-496f-883a-fc9035bf2faf admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.481596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.482269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.482557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.482873 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.483602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.485211 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.498091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1267/2547] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:13:56.502229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.512528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bbbb7-f04f-4fe0-ae79-2e499284b2f4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.517328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.517989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.518270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.518542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.519315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.520901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73719faf-a095-4861-8b28-4ff553450caf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.530741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1281/2548] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:13:56.534885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.545105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabc53e-a3d1-4cdc-b069-451577fb5ac1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.551364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.552253 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.552568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.552856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] PATH_INFO: `/v3/projects/1e8c16b8e2564e468f11fb0bfdade484/users/dc4e99689ba54f67bce199ca2779c331/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.569063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8c16b8e2564e468f11fb0bfdade484, user_id=dc4e99689ba54f67bce199ca2779c331, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.571668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.586379 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1268/2549] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:13:56 2022] PUT /identity/v3/projects/1e8c16b8e2564e468f11fb0bfdade484/users/dc4e99689ba54f67bce199ca2779c331/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:13:56.591570 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f9d-b0b6-4e76-b807-657d59d7f26b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.591863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f9d-b0b6-4e76-b807-657d59d7f26b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.592139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355f9d-b0b6-4e76-b807-657d59d7f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.610501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-89355f9d-b0b6-4e76-b807-657d59d7f26b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:13:56.611727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-89355f9d-b0b6-4e76-b807-657d59d7f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:56.672112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1282/2550] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:13:56.681917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:13:56.683712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:13:56.739489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c32c52-0614-4508-9852-f9d8f55d83a9 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:13:56.743400 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:13:56.744138 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:13:56.744424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:13:56.744807 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:13:56.755443 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:13:56.757080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:13:56.767226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1269/2551] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:01.329016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee786-8822-45d5-95cd-ae3f6d4cccb7 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:01.329931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee786-8822-45d5-95cd-ae3f6d4cccb7 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:01.330364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ee786-8822-45d5-95cd-ae3f6d4cccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:01.378837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-351ee786-8822-45d5-95cd-ae3f6d4cccb7 None None] MFA Rules not processed for user `dc4e99689ba54f67bce199ca2779c331`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:01.380502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-351ee786-8822-45d5-95cd-ae3f6d4cccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:01.452852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1283/2552] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:01.466128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:01.468338 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:01.551155 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275448c5-4d6c-4604-b5b3-c6dabf05ab2e service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:01.556954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:01.557653 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:01.557939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:01.558212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:01.568913 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:01.570771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:01.581161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1270/2553] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:03.183641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:03.184172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:03.184306 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:03.203201 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] MFA Rules not processed for user `dc4e99689ba54f67bce199ca2779c331`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:03.204504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:03.211877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1284/2554] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:03.249295 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:03.250796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:03.308304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5153-fd9a-4bbf-851c-98e4a04a5f3c service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:03.312623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:03.313288 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:03.313574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:03.313846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:03.315865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:03.329965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:03.331447 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:03.342614 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1271/2555] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:04.010326 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:04.012877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:04.028798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc8d8-4b7e-4302-9103-5550e086c01a None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:04.037141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:04.037916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:04.038311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:04.038696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:04.041066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:04.056460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:04.059164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:04.076607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1285/2556] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:25.118966 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.120579 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:25.134537 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef324-51a0-4f9e-a17e-f66ad02e3e09 service glance] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.139855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.140725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.141011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.141283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] PATH_INFO: `/v3/users/ac87a6bd2eef40c58f71e7a787e18651` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.142494 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac87a6bd2eef40c58f71e7a787e18651)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.144509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.193316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac87a6bd2eef40c58f71e7a787e18651'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.194003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac87a6bd2eef40c58f71e7a787e18651'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.202085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac87a6bd2eef40c58f71e7a787e18651'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.213658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac87a6bd2eef40c58f71e7a787e18651'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.220776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-73e586c9-d822-4896-a122-d34b443b1263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac87a6bd2eef40c58f71e7a787e18651'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.227242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1272/2557] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:14:25 2022] DELETE /identity/v3/users/ac87a6bd2eef40c58f71e7a787e18651 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:25.402302 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.413120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bf6-d476-4364-954b-dce3643e67e0 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.470830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.471745 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.472022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.472293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] PATH_INFO: `/v3/projects/bbdc40573f43486bb7c7a2fc5f262033` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.473595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdc40573f43486bb7c7a2fc5f262033)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.475604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.523930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdc40573f43486bb7c7a2fc5f262033', 'request_id': 'req-e4e8da18-813f-4966-93b7-9c4c2424aac1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.529499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdc40573f43486bb7c7a2fc5f262033', 'request_id': 'req-e4e8da18-813f-4966-93b7-9c4c2424aac1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.535896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdc40573f43486bb7c7a2fc5f262033', 'request_id': 'req-e4e8da18-813f-4966-93b7-9c4c2424aac1'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.550577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] The token cache is being invalidate because project bbdc40573f43486bb7c7a2fc5f262033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:14:25.550927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.551582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-e4e8da18-813f-4966-93b7-9c4c2424aac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:25.553226 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1286/2558] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:14:25 2022] DELETE /identity/v3/projects/bbdc40573f43486bb7c7a2fc5f262033 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:25.558489 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.558816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.559094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.578063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:25.579287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:25.643099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1273/2559] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:25.652448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.652749 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.653029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.671628 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:25.672846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:25.681038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1287/2560] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:25.685939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.700474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b830-cf71-4049-9d19-42e7e22c3d51 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.708884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.709554 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.709832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.710104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.710861 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:14:25.711167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.712797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.724718 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1274/2561] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:14:25.729084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.738435 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fdb78-c8ba-490d-a961-4b9913240196 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.743530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.744192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.744474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.744783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.745480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.747443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.776676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1288/2562] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:14:25 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:14:25.780844 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.790847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ef7d-6ed3-4c75-bb7d-8bfe2fe15cea admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.847817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.848474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.848755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.849026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.849793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.851726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.872917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1275/2563] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:14:25 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:14:25.877269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.888173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8b47-8c95-4c4c-a8f6-ce0fc2dead96 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.892914 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.893580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.893864 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.894142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.894909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.896535 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.906855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1289/2564] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:25.910805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.921092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0832fc-01c3-43da-874b-f70f741087d1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.926093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.926783 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.927063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.927321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.928039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.929622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014c77b-5c31-4b4b-bf83-aafd95cdd2ff admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:25.939625 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1276/2565] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:25.944064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:25.958945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe944c-ce05-4170-94a0-e9870763ec95 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:25.966413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:25.967606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:25.967908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:25.968231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] PATH_INFO: `/v3/projects/8610344852474a56bcd59dfcbf48bb32/users/06316ae4a7cd46cdb46635ec8da4ef20/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:25.984944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8610344852474a56bcd59dfcbf48bb32, user_id=06316ae4a7cd46cdb46635ec8da4ef20, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:25.987606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:26.006360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1290/2566] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:14:25 2022] PUT /identity/v3/projects/8610344852474a56bcd59dfcbf48bb32/users/06316ae4a7cd46cdb46635ec8da4ef20/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:14:26.016923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:26.017264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:26.017567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:26.049402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] MFA Rules not processed for user `06316ae4a7cd46cdb46635ec8da4ef20`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:26.050553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:26.125769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1277/2567] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:26.138500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:26.140568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:26.199462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cbd9d-1d82-45ea-b100-52981300b910 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:26.203961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:26.204615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:26.204896 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:26.205168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:26.214804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:26.216253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d8c8a-f39d-4835-b419-d5329e3e197c service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:26.225709 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1291/2568] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:34.338250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:34.406841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9748d-a8bf-44ec-9008-25343d99b2e7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:34.411707 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:34.412613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:34.412898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:34.413174 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] PATH_INFO: `/v3/users/06316ae4a7cd46cdb46635ec8da4ef20` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:34.414416 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] RBAC: Authorizing `identity:delete_user(user_id=06316ae4a7cd46cdb46635ec8da4ef20)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:34.416514 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:34.467559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06316ae4a7cd46cdb46635ec8da4ef20'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:34.468216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06316ae4a7cd46cdb46635ec8da4ef20'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:34.478007 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06316ae4a7cd46cdb46635ec8da4ef20'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:34.492483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06316ae4a7cd46cdb46635ec8da4ef20'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:34.499683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06316ae4a7cd46cdb46635ec8da4ef20'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:34.505780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1278/2569] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:14:34 2022] DELETE /identity/v3/users/06316ae4a7cd46cdb46635ec8da4ef20 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:34.510761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:34.511269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:34.511375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:34.530409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:34.531735 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:34.599057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1292/2570] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:34.608849 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:34.610382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:34.670596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617bd8a-30ee-41f1-8318-1573b65d24be admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:34.674582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:34.675255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:34.675544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:34.675810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:34.685105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:34.686539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:34.696394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1279/2571] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:34.969269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:34.970754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:34.982391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ea62f-6292-4828-a51c-a241165f8579 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:34.987104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:34.987974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:34.988252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:34.988521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] PATH_INFO: `/v3/projects/8610344852474a56bcd59dfcbf48bb32` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:34.989766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8610344852474a56bcd59dfcbf48bb32)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:34.991791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:35.038278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8610344852474a56bcd59dfcbf48bb32', 'request_id': 'req-67be9fdb-8688-4e67-abfd-e2129929e110'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:35.043432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8610344852474a56bcd59dfcbf48bb32', 'request_id': 'req-67be9fdb-8688-4e67-abfd-e2129929e110'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:35.049273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8610344852474a56bcd59dfcbf48bb32', 'request_id': 'req-67be9fdb-8688-4e67-abfd-e2129929e110'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:35.062988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] The token cache is being invalidate because project 8610344852474a56bcd59dfcbf48bb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:14:35.063268 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:35.063866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:35.065409 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1293/2572] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:14:34 2022] DELETE /identity/v3/projects/8610344852474a56bcd59dfcbf48bb32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:44.778559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:44.780363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:44.872215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d57e-5131-4fd7-ae27-8c947fc6cf44 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:44.944200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:44.945096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:44.945541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:44.946011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:44.949361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:44.962976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:44.964826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:44.977222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1280/2573] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:48.698422 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:48.699970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:48.758034 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be9fdb-8688-4e67-abfd-e2129929e110 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:48.762044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:48.763046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:48.763337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:48.763612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:48.765439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:48.824052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:48.825479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:48.835107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1294/2574] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:52.111559 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.113118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:52.127642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fdf9c-39ab-4a53-ac8b-7328d654ec33 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.135261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.136333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.136609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.136851 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] PATH_INFO: `/v3/users/a0661916b4064097a834dcef7e02b3ee` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.152366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0661916b4064097a834dcef7e02b3ee)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.155543 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.207715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0661916b4064097a834dcef7e02b3ee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.208374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0661916b4064097a834dcef7e02b3ee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.216887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0661916b4064097a834dcef7e02b3ee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.228307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0661916b4064097a834dcef7e02b3ee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.234908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e472e44b-18c2-4cbc-bd96-7c072973f1d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0661916b4064097a834dcef7e02b3ee'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.242330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1281/2575] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:14:52 2022] DELETE /identity/v3/users/a0661916b4064097a834dcef7e02b3ee => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:52.424639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.435068 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a613e-6bc5-48ce-8703-bd0ebf744ced service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.493995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.494909 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.495194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.495468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] PATH_INFO: `/v3/projects/984d4a492510482d88f7aec954117969` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.505985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=984d4a492510482d88f7aec954117969)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.507955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.554595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984d4a492510482d88f7aec954117969', 'request_id': 'req-cab98401-e7f8-4cba-8ded-5ef112a7ad83'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.560221 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984d4a492510482d88f7aec954117969', 'request_id': 'req-cab98401-e7f8-4cba-8ded-5ef112a7ad83'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.566907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984d4a492510482d88f7aec954117969', 'request_id': 'req-cab98401-e7f8-4cba-8ded-5ef112a7ad83'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.581415 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] The token cache is being invalidate because project 984d4a492510482d88f7aec954117969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:14:52.581693 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.582287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cab98401-e7f8-4cba-8ded-5ef112a7ad83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:52.583901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1295/2576] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:14:52 2022] DELETE /identity/v3/projects/984d4a492510482d88f7aec954117969 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:52.589082 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.589373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.589650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.608310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:52.609505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:52.671037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1282/2577] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:52.678743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.678976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.679347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.698673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:52.699942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:52.709128 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1296/2578] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:52.713645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.723768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea55c3-1caf-4b6b-9676-747d62efad86 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.728607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.729274 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.729557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.729831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.730561 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:14:52.730897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.732570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.744350 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1283/2579] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:14:52.748984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.758324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba7e42-a04f-4d1a-a5a8-72295c947e08 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.763593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.764249 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.764697 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.764977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.765667 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.767607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.797381 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1297/2580] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:14:52 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:14:52.798609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.809732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77d08-7293-495a-b662-56f29a2dc4e0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.869716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.870401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.870676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.870986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.871685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.873618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.896380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1284/2581] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:14:52 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:14:52.900743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.911540 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae224-142c-4e14-b48f-8248e3473a77 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.916376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.917085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.917341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.917612 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.918342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.920054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.934815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1298/2582] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:52.935479 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.945771 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142b68-f646-4a86-9171-4eaff2c72470 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.950626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.951307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.951586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.951863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.952611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:52.954194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264955-4ddd-4dbd-a893-baa5af89f711 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:52.963782 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1285/2583] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:14:52.968036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:52.977957 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ea5dc-857b-455d-9922-295d9741c59b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:52.983058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:52.983930 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:52.984207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:52.984477 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] PATH_INFO: `/v3/projects/24cdc6f013424c6f8ecfa3826abe3279/users/1d5a98f8c0f44c41810ba8fcd3442d21/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:52.999346 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cdc6f013424c6f8ecfa3826abe3279, user_id=1d5a98f8c0f44c41810ba8fcd3442d21, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:53.002146 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:53.023011 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1299/2584] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:14:52 2022] PUT /identity/v3/projects/24cdc6f013424c6f8ecfa3826abe3279/users/1d5a98f8c0f44c41810ba8fcd3442d21/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:53.035789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:53.036094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:53.036368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:53.063405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] MFA Rules not processed for user `1d5a98f8c0f44c41810ba8fcd3442d21`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:53.064628 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:53.127595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1286/2585] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:53.139701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:53.142010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:53.215851 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241cb00-9523-4fa5-8e7d-72b82212dbaf admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:53.221755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:53.222404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:53.222696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:53.222978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:53.230781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:53.232388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feb20bc-5270-4720-b5c8-d6d1aa975438 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:53.241140 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1300/2586] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:53.419441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:53.485505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eaa65-26a1-4d17-9df8-a731ca5e0fde None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:53.490366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:53.491285 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:53.491565 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:53.491823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] PATH_INFO: `/v3/users/1d5a98f8c0f44c41810ba8fcd3442d21` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:53.493078 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5a98f8c0f44c41810ba8fcd3442d21)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:53.495063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:53.546576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5a98f8c0f44c41810ba8fcd3442d21'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:53.547258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5a98f8c0f44c41810ba8fcd3442d21'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:53.556361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5a98f8c0f44c41810ba8fcd3442d21'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:53.568141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5a98f8c0f44c41810ba8fcd3442d21'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:53.574889 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5a98f8c0f44c41810ba8fcd3442d21'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:53.581142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1287/2587] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:14:53 2022] DELETE /identity/v3/users/1d5a98f8c0f44c41810ba8fcd3442d21 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:53.586136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:53.586634 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:53.586751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:53.605057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:53.606270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:53.668674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1301/2588] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:53.678954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:53.680654 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:53.751369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f06c-daa0-46a9-9182-63079074ee1c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:53.755388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:53.756060 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:53.756344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:53.756623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:53.766355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:53.767848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fdf45-8b0c-4faf-9b07-85fa6532c608 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:53.777534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1288/2589] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:14:54.054176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.055869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:54.069453 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2244b-a51e-4689-8412-cce23fb6c425 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.075093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.075967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.076252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.076661 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] PATH_INFO: `/v3/projects/24cdc6f013424c6f8ecfa3826abe3279` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.078139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cdc6f013424c6f8ecfa3826abe3279)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.080090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.129323 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cdc6f013424c6f8ecfa3826abe3279', 'request_id': 'req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:54.135304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cdc6f013424c6f8ecfa3826abe3279', 'request_id': 'req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:54.142394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cdc6f013424c6f8ecfa3826abe3279', 'request_id': 'req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:54.157988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] The token cache is being invalidate because project 24cdc6f013424c6f8ecfa3826abe3279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:14:54.158276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:54.158997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-66b32f8c-dc9d-4d37-90b2-bd3661d4c8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:14:54.160737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1302/2590] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:14:54 2022] DELETE /identity/v3/projects/24cdc6f013424c6f8ecfa3826abe3279 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:54.165751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.166257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.166257 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.185277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:54.186495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:54.245642 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1289/2591] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:54.253560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.253855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.254131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.273283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:54.274469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:54.283621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1303/2592] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:54.289746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.301255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11a322-5c13-4ba7-8da5-3e6ecac5d8d7 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.307927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.308596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.308874 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.309148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.309892 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:14:54.310328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.311916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.327769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1290/2593] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 01 10:14:54.332183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.341539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4273-2835-4e57-a4a1-c4f54f51f131 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.347151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.347810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.348092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.348394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.349097 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.351026 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.379047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1304/2594] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:14:54.383731 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.395301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b9ad-eb18-4dbd-8d16-67a4bdd48607 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.453665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.454337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.454624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.454926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.455624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.457535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.478679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1291/2595] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:14:54.482978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.493659 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a497537-6c8f-4fbf-809b-00433688eeaa admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.500363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.501032 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.501331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.501609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.502363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.504002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.514610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1305/2596] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:54.518684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.529259 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cef8e-0308-47ab-aaaf-eef2325b001a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.534885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.535609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.535897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.536178 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.536916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.538546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e68352-f2c9-4d88-bf71-7de67b4844db admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.549103 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1292/2597] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:54.553363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.563702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c69ed-94b7-4e36-ac49-4b3c445288bb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.569574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.570455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.570768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.571042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] PATH_INFO: `/v3/projects/b4f6c7f4de04455fb4777d0a2714d164/users/676a2bc51ae745739608a3af998653ec/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.586938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f6c7f4de04455fb4777d0a2714d164, user_id=676a2bc51ae745739608a3af998653ec, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.589577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.606372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1306/2598] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:14:54 2022] PUT /identity/v3/projects/b4f6c7f4de04455fb4777d0a2714d164/users/676a2bc51ae745739608a3af998653ec/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:54.619179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.619566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.619993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.650676 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] MFA Rules not processed for user `676a2bc51ae745739608a3af998653ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:54.651922 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:54.723737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1293/2599] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:54.728556 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.800389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b82604-0275-45ca-a512-950c01b0bd4f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.806622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.807308 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.807602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.807879 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.808623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.810581 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.838960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1307/2600] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:14:54.843284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.854451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32684f83-9ea2-46d9-a67f-2acc8ace7572 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.920391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.921080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.921412 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.921691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.922484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.924539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.945981 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1294/2601] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:14:54 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:14:54.951906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:54.963859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf11b-49c1-4e1e-b507-d4646053013f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:54.969663 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:54.970359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:54.970684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:54.970993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:54.971784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:54.973492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:54.984981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1308/2602] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:54.989674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:55.004748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5de198-b705-4f74-b951-34286bb8e824 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:55.013866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:55.015236 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.015538 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.015817 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] PATH_INFO: `/v3/projects/bc598808538746b0bae1ba70c9ff7836/users/a9bd9cade2a34ddb9239b1b7fa2fe83f/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.031882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc598808538746b0bae1ba70c9ff7836, user_id=a9bd9cade2a34ddb9239b1b7fa2fe83f, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:55.034599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:55.050911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1295/2603] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:14:54 2022] PUT /identity/v3/projects/bc598808538746b0bae1ba70c9ff7836/users/a9bd9cade2a34ddb9239b1b7fa2fe83f/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:55.054951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:55.065008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10892a-71fe-41f6-a6dd-48cc533f2f81 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:55.131490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:55.132159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.132444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.132719 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.133438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:55.135081 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadbd66-1f95-4ee3-b9f9-13cecd6c4b65 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:55.145606 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1309/2604] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:14:55.151466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:55.162265 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8f2ad-849a-4c92-a960-c019a7c41377 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:55.167548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:55.168438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.168716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.168984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] PATH_INFO: `/v3/projects/bc598808538746b0bae1ba70c9ff7836/users/a9bd9cade2a34ddb9239b1b7fa2fe83f/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.171173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc598808538746b0bae1ba70c9ff7836, user_id=a9bd9cade2a34ddb9239b1b7fa2fe83f, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:55.173774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:55.183974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1296/2605] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:14:55 2022] PUT /identity/v3/projects/bc598808538746b0bae1ba70c9ff7836/users/a9bd9cade2a34ddb9239b1b7fa2fe83f/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:14:55.195123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.195502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.195857 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.223508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] MFA Rules not processed for user `a9bd9cade2a34ddb9239b1b7fa2fe83f`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:14:55.224689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:55.297172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1310/2606] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:14:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:14:55.310240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:55.312748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:14:55.373054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc079ef-d2b0-4bdd-ac40-848121e0efa7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:55.377955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:55.378606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.378927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.379208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.389646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:55.391136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:55.400647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1297/2607] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:14:55.478134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:14:55.488246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611cb1c-828b-4b31-9ae3-4d8742ec3824 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:14:55.492608 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:14:55.493572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:14:55.493572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:14:55.493784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:14:55.552035 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:14:55.553459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f65753-9f59-4208-9bb5-514168af825a service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:14:55.562153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1311/2608] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:05.494386 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:05.559716 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575317a3-50a3-4fef-9aae-393258dfce89 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:05.565250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:05.566213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:05.566497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:05.566813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] PATH_INFO: `/v3/users/676a2bc51ae745739608a3af998653ec` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:05.568165 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=676a2bc51ae745739608a3af998653ec)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:05.570120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:05.623880 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676a2bc51ae745739608a3af998653ec'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:05.624511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676a2bc51ae745739608a3af998653ec'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:05.633448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676a2bc51ae745739608a3af998653ec'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:05.645408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676a2bc51ae745739608a3af998653ec'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:05.651967 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676a2bc51ae745739608a3af998653ec'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:05.657742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1298/2609] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:05 2022] DELETE /identity/v3/users/676a2bc51ae745739608a3af998653ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:05.662560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:05.663082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:05.663190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:05.681665 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:05.682913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:05.746246 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1312/2610] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:15:05.756509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:05.758117 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:05.816500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1588-34ca-46e3-ba71-99dcc7fa5613 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:05.820806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:05.821474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:05.821766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:05.822055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:05.832365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:05.833850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:05.843417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1299/2611] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:06.106679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:06.108289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:06.120640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220bdb8-2830-4dda-a0d2-1ecb8a2bbf39 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:06.125492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:06.126387 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.126671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.126975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] PATH_INFO: `/v3/projects/b4f6c7f4de04455fb4777d0a2714d164` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.128254 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f6c7f4de04455fb4777d0a2714d164)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:06.130152 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:06.179062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f6c7f4de04455fb4777d0a2714d164', 'request_id': 'req-61650fdb-f4cd-495d-987d-133388862cfb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.184320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f6c7f4de04455fb4777d0a2714d164', 'request_id': 'req-61650fdb-f4cd-495d-987d-133388862cfb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.190229 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f6c7f4de04455fb4777d0a2714d164', 'request_id': 'req-61650fdb-f4cd-495d-987d-133388862cfb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.203629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] The token cache is being invalidate because project b4f6c7f4de04455fb4777d0a2714d164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:06.203923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.204542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.206179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1313/2612] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:06 2022] DELETE /identity/v3/projects/b4f6c7f4de04455fb4777d0a2714d164 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:06.210243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:06.219788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260580-187d-4a2b-b0cb-711c25c97ddf service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:06.286002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:06.286919 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.287204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.287487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] PATH_INFO: `/v3/users/a9bd9cade2a34ddb9239b1b7fa2fe83f` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.288878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9bd9cade2a34ddb9239b1b7fa2fe83f)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:06.290845 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:06.339870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9bd9cade2a34ddb9239b1b7fa2fe83f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.340527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9bd9cade2a34ddb9239b1b7fa2fe83f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.348212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9bd9cade2a34ddb9239b1b7fa2fe83f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.359533 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9bd9cade2a34ddb9239b1b7fa2fe83f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.366587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9689c08b-4ad1-44c2-a9ef-796d8761abf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9bd9cade2a34ddb9239b1b7fa2fe83f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.378569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1300/2613] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:06 2022] DELETE /identity/v3/users/a9bd9cade2a34ddb9239b1b7fa2fe83f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:06.670116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:06.671736 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:06.686014 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61650fdb-f4cd-495d-987d-133388862cfb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:06.742431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:06.743256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.743542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.743819 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] PATH_INFO: `/v3/projects/bc598808538746b0bae1ba70c9ff7836` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.745154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc598808538746b0bae1ba70c9ff7836)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:06.747122 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:06.794425 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc598808538746b0bae1ba70c9ff7836', 'request_id': 'req-318ec5ce-8efc-468b-b12c-fffa939f1e7a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.799777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc598808538746b0bae1ba70c9ff7836', 'request_id': 'req-318ec5ce-8efc-468b-b12c-fffa939f1e7a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.805844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc598808538746b0bae1ba70c9ff7836', 'request_id': 'req-318ec5ce-8efc-468b-b12c-fffa939f1e7a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.824850 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] The token cache is being invalidate because project bc598808538746b0bae1ba70c9ff7836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:06.825137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.825841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-318ec5ce-8efc-468b-b12c-fffa939f1e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:06.828274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1314/2614] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:06 2022] DELETE /identity/v3/projects/bc598808538746b0bae1ba70c9ff7836 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:06.834068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.834581 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.834803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.853440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:06.854674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:06.921937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1301/2615] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:15:06.930103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.930393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.930815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.951571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:06.952770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:06.962245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1315/2616] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:06.966835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:06.976860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31057-cbcd-416f-8f04-d5be7cdde149 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:06.982795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:06.983476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:06.983759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:06.984026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:06.984758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:15:06.985061 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:06.986672 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:06.999957 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1302/2617] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:15:07.004364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.014335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27729396-d56d-47af-96ce-dba19b91e4f6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.019899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.020580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.020859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.021127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.021863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.023797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.059684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1316/2618] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:07.066091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.076801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100b91c-6cf8-41cc-9f78-4eed10267ca5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.134435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.135215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.135498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.135780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.136471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.138762 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.163182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1303/2619] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:07.167999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.179015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adcf8d-c283-44d2-a324-b1caeaf37e5f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.185324 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.185991 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.186271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.186544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.187307 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.188912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.199785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1317/2620] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:07.203875 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.214373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb760b-1a2b-4246-be99-13fe81875fc8 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.220136 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.220799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.221180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.221468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.222226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.223852 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8164-d8d6-4a97-93ba-5bddabdd03d1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.234064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1304/2621] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:07.238301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.248836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430086-c686-40bb-af44-7f8488590eb9 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.254713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.255550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.255828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.256099 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] PATH_INFO: `/v3/projects/0c518fc9f6034a9b92f7e995f1e59ffd/users/cefc59e3bdc046b4a7d767104148b14f/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.271460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c518fc9f6034a9b92f7e995f1e59ffd, user_id=cefc59e3bdc046b4a7d767104148b14f, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.274091 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.288734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1318/2622] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:07 2022] PUT /identity/v3/projects/0c518fc9f6034a9b92f7e995f1e59ffd/users/cefc59e3bdc046b4a7d767104148b14f/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:07.300358 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.300674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.300985 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.329058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] MFA Rules not processed for user `cefc59e3bdc046b4a7d767104148b14f`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:07.330465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:07.393665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1305/2623] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:07.398490 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.461174 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8bfe-d431-4ad6-a0a0-6d87e8f6bd0d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.465887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.466571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.466898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.467178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.468087 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.470031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.500595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1319/2624] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:07.501940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.512900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abaa6f-0ae5-4eb7-a105-c9f1f44b6538 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.570477 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.571185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.571466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.571741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.572440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.574364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.596658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1306/2625] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:07.601682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.612052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5f8d-ee92-4bf3-b9c3-1b98f7944670 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.616921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.617586 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.617868 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.618144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.618910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.620530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.630935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1320/2626] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:07.635249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.646530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98239d5f-2241-436e-a9f7-79adab12337d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.652437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.653452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.653735 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.654010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] PATH_INFO: `/v3/projects/5239dda16b4c416a8d1553964e33a587/users/a21ba7f286a4402bb9b15d45ea73ad5e/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.668788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5239dda16b4c416a8d1553964e33a587, user_id=a21ba7f286a4402bb9b15d45ea73ad5e, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.671509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.686927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1307/2627] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:07 2022] PUT /identity/v3/projects/5239dda16b4c416a8d1553964e33a587/users/a21ba7f286a4402bb9b15d45ea73ad5e/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:07.691462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.701525 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443110-2f30-44a8-84ee-147cf3e17151 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.758080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.758805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.759178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.759460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.760178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.761782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919482-cf63-4c9a-a613-f322e3055bcf admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.771880 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1321/2628] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:07.777826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.793142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0c46f-52b6-4563-8cc3-e46427b248b0 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:07.800524 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:07.801406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.801687 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.801959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] PATH_INFO: `/v3/projects/5239dda16b4c416a8d1553964e33a587/users/a21ba7f286a4402bb9b15d45ea73ad5e/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.804000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5239dda16b4c416a8d1553964e33a587, user_id=a21ba7f286a4402bb9b15d45ea73ad5e, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:07.806591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:07.816920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1308/2629] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:07 2022] PUT /identity/v3/projects/5239dda16b4c416a8d1553964e33a587/users/a21ba7f286a4402bb9b15d45ea73ad5e/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:15:07.827071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:07.827362 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:07.827635 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:07.854518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] MFA Rules not processed for user `a21ba7f286a4402bb9b15d45ea73ad5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:07.855775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:07.923713 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1322/2630] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:07.939584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:07.941971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:08.001308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79738f-e914-4444-87d0-da2fc0fed990 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:08.005434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:08.006070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:08.006351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:08.006627 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:08.016819 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:08.018242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:08.028371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1309/2631] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:08.107033 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:08.120974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78874a-dd4c-4332-b7f4-f52ffb23c725 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:08.125572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:08.126241 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:08.126518 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:08.126818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:08.185419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:08.186938 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7bcb3-ef47-4306-9db3-708864df8be3 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:08.196439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1323/2632] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:10.956766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:11.019811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaaa4e-a374-4863-a02d-4de372fb2f15 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:11.024918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:11.025785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:11.026040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:11.026345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] PATH_INFO: `/v3/users/cefc59e3bdc046b4a7d767104148b14f` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:11.027616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cefc59e3bdc046b4a7d767104148b14f)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:11.029527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:11.078936 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cefc59e3bdc046b4a7d767104148b14f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.079545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cefc59e3bdc046b4a7d767104148b14f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.088137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cefc59e3bdc046b4a7d767104148b14f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.099636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cefc59e3bdc046b4a7d767104148b14f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.106190 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cefc59e3bdc046b4a7d767104148b14f'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.112160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1310/2633] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:10 2022] DELETE /identity/v3/users/cefc59e3bdc046b4a7d767104148b14f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:11.116931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:11.117424 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:11.117531 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:11.135571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:11.136766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:11.214479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1324/2634] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:11.225172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:11.227185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:11.289780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7bd8-5385-4c74-88d0-af5eaf290904 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:11.294221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:11.294969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:11.295254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:11.295534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:11.305077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:11.306509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:11.317433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1311/2635] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:11.584990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:11.586444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:11.598698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a60db0-fc9f-45fd-85c0-c1a01158b831 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:11.604645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:11.605551 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:11.605831 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:11.606104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] PATH_INFO: `/v3/projects/0c518fc9f6034a9b92f7e995f1e59ffd` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:11.607494 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c518fc9f6034a9b92f7e995f1e59ffd)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:11.609419 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:11.657799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c518fc9f6034a9b92f7e995f1e59ffd', 'request_id': 'req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.663161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c518fc9f6034a9b92f7e995f1e59ffd', 'request_id': 'req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.669183 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c518fc9f6034a9b92f7e995f1e59ffd', 'request_id': 'req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.682804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] The token cache is being invalidate because project 0c518fc9f6034a9b92f7e995f1e59ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:11.683094 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.683746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.685376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1325/2636] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:11 2022] DELETE /identity/v3/projects/0c518fc9f6034a9b92f7e995f1e59ffd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:11.689426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:11.699437 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb29e9-a22d-4579-9be8-f441b9a65ce4 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:11.760739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:11.761619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:11.761903 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:11.762189 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] PATH_INFO: `/v3/users/a21ba7f286a4402bb9b15d45ea73ad5e` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:11.763833 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21ba7f286a4402bb9b15d45ea73ad5e)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:11.765768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:11.814636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21ba7f286a4402bb9b15d45ea73ad5e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.815337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21ba7f286a4402bb9b15d45ea73ad5e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.825140 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21ba7f286a4402bb9b15d45ea73ad5e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.836810 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21ba7f286a4402bb9b15d45ea73ad5e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.843331 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-e4642851-f9a9-4ec1-b27f-30f45a98c9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21ba7f286a4402bb9b15d45ea73ad5e'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:11.849363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1312/2637] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:11 2022] DELETE /identity/v3/users/a21ba7f286a4402bb9b15d45ea73ad5e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:12.117759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.119376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:12.134823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4dcfa-0df5-47a7-8eb2-74a625a4f78e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.195084 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.195980 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.196264 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.196523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] PATH_INFO: `/v3/projects/5239dda16b4c416a8d1553964e33a587` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.197716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5239dda16b4c416a8d1553964e33a587)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.199703 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.246698 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5239dda16b4c416a8d1553964e33a587', 'request_id': 'req-ab3229be-46c8-4c09-a59c-f885a3e82b45'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:12.252180 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5239dda16b4c416a8d1553964e33a587', 'request_id': 'req-ab3229be-46c8-4c09-a59c-f885a3e82b45'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:12.258088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5239dda16b4c416a8d1553964e33a587', 'request_id': 'req-ab3229be-46c8-4c09-a59c-f885a3e82b45'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:12.272536 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] The token cache is being invalidate because project 5239dda16b4c416a8d1553964e33a587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:12.272825 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:12.273443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ab3229be-46c8-4c09-a59c-f885a3e82b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:12.274994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1326/2638] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:12 2022] DELETE /identity/v3/projects/5239dda16b4c416a8d1553964e33a587 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:12.280478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.281343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.281626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.300120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:12.301372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:12.359278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1313/2639] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:12.368395 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.368564 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.368856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.387347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:12.388872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:12.397130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1327/2640] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:15:12.401429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.412101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca7902-4c8a-4ce6-8100-a7d254f34a8a None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.417315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.417974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.418258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.418545 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.419322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:15:12.419637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.421282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.432610 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1314/2641] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:15:12.437179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.446602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf999a-c7ad-4f21-8fb3-eba0ad020790 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.453058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.453722 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.454008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.454280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.455047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.457104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.486846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1328/2642] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:12.491194 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.501248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91c011-b0c4-4e72-93ea-1ce01d6da19f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.556776 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.557421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.557741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.558011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.558695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.560624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.589804 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1315/2643] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:15:12.594922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.606200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd97490-0ed0-42cd-9518-97ee450696cc admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.611970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.612640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.612925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.613205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.613937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.615583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.626543 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1329/2644] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:12.631381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.644712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0fc5-0a5d-46b1-8862-59b6c2c743b3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.651091 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.651774 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.652057 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.652335 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.653070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.654683 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790010-f665-4c6d-aea2-a4385723555c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.665317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1316/2645] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:12.669579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.679714 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580ef07-cdc0-46f4-ad5b-046943d9b65b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.684695 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.685577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.685863 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.686147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] PATH_INFO: `/v3/projects/275155aafa41471196e48de63322e0b3/users/265252c5df2b4b459cbbeb6d60d26f4f/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.700859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275155aafa41471196e48de63322e0b3, user_id=265252c5df2b4b459cbbeb6d60d26f4f, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.703537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.720696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1330/2646] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:12 2022] PUT /identity/v3/projects/275155aafa41471196e48de63322e0b3/users/265252c5df2b4b459cbbeb6d60d26f4f/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:15:12.731067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.731363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.731649 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.757962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] MFA Rules not processed for user `265252c5df2b4b459cbbeb6d60d26f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:12.759217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:12.822388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1317/2647] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:12.827205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.898102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba7b49-a14d-474e-9933-af3e22a9b370 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:12.903838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:12.904687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:12.904975 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:12.905248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:12.905953 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:12.907923 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:12.937538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1331/2648] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:12.942465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:12.958170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d203cc-636a-4b13-b429-c9a2dabda9e2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.016064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.016724 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.017004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.017275 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.017954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.020047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.042105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1318/2649] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:12 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:13.046271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:13.057095 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8582c5-91a8-43aa-b262-a9ad92f2f150 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.061913 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.062582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.062907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.063186 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.063965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.065600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.075902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1332/2650] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:13.080080 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:13.089938 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f0c4-6f47-4fdf-a4c8-f448a601ff84 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.094786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.095670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.095952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.096225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] PATH_INFO: `/v3/projects/b4c2dc603c3242b68e782564908aac1e/users/c8d12fe2cb21443aacc52bee29a68888/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.110995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c2dc603c3242b68e782564908aac1e, user_id=c8d12fe2cb21443aacc52bee29a68888, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.113686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.129251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1319/2651] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:13 2022] PUT /identity/v3/projects/b4c2dc603c3242b68e782564908aac1e/users/c8d12fe2cb21443aacc52bee29a68888/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:13.133248 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:13.144645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a15265-c962-4d89-baca-8ef2be92f338 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.199970 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.200560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.200845 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.201123 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.201844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.203480 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b9ee-3e5a-4a56-bf1d-fb76e351c581 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.213022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1333/2652] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:13.217371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:13.228467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcb70-e364-4a6e-b07f-619b46702ca2 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.233530 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.234424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.234738 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.235009 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] PATH_INFO: `/v3/projects/b4c2dc603c3242b68e782564908aac1e/users/c8d12fe2cb21443aacc52bee29a68888/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.237071 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c2dc603c3242b68e782564908aac1e, user_id=c8d12fe2cb21443aacc52bee29a68888, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.239811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.250473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1320/2653] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:13 2022] PUT /identity/v3/projects/b4c2dc603c3242b68e782564908aac1e/users/c8d12fe2cb21443aacc52bee29a68888/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:13.260769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.261059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.261330 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.287711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] MFA Rules not processed for user `c8d12fe2cb21443aacc52bee29a68888`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:13.288911 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:13.359610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1334/2654] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:13.371033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:13.373095 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:13.432164 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992200e8-588e-4cfe-811d-802e32057996 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:13.437039 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:13.437691 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:13.437977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:13.438254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:13.495429 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:13.496879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:13.505896 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1321/2655] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:15.303537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:15.305102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:15.363443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb274a-dda2-49a2-97f1-b448fb5873a8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:15.367407 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:15.368056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:15.368333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:15.368614 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:15.370515 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:15.380153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:15.381580 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:15.389752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1335/2656] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:19.160504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:19.162166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:19.174283 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ab588-d8cf-43cc-9990-7615ce12e2b9 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:19.178485 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:19.179188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:19.179475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:19.179753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:19.189558 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:19.191215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b35b02-7753-4188-850e-7b325a3db564 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:19.201850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1322/2657] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:48.325807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:48.394171 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657605b1-c1f7-475d-80bb-34bb75aaddab service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:48.400076 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:48.400998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:48.401300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:48.401577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] PATH_INFO: `/v3/users/265252c5df2b4b459cbbeb6d60d26f4f` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:48.402919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=265252c5df2b4b459cbbeb6d60d26f4f)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:48.404894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:48.461501 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265252c5df2b4b459cbbeb6d60d26f4f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:48.470361 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265252c5df2b4b459cbbeb6d60d26f4f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:48.482092 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265252c5df2b4b459cbbeb6d60d26f4f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:48.482739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265252c5df2b4b459cbbeb6d60d26f4f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:48.483335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265252c5df2b4b459cbbeb6d60d26f4f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:48.496121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1336/2658] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:48 2022] DELETE /identity/v3/users/265252c5df2b4b459cbbeb6d60d26f4f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:48.500714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:48.501207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:48.501306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:48.520224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:48.521410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:48.579299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1323/2659] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:48.589173 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:48.591013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:48.652609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b77aff-a578-4870-ad45-6c134452f4da admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:48.656615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:48.657271 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:48.657552 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:48.657818 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:48.667158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:48.668589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:48.678031 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1337/2660] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:48.960070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:48.961600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:48.974284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307fe03-2755-4825-b956-43189d6872f1 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:48.980014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:48.980895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:48.981179 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:48.981456 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] PATH_INFO: `/v3/projects/275155aafa41471196e48de63322e0b3` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:48.982869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=275155aafa41471196e48de63322e0b3)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:48.984786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:49.041965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275155aafa41471196e48de63322e0b3', 'request_id': 'req-6af78cda-275a-4824-9f56-05a3bb99e881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.048343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275155aafa41471196e48de63322e0b3', 'request_id': 'req-6af78cda-275a-4824-9f56-05a3bb99e881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.054586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275155aafa41471196e48de63322e0b3', 'request_id': 'req-6af78cda-275a-4824-9f56-05a3bb99e881'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.068785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] The token cache is being invalidate because project 275155aafa41471196e48de63322e0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:49.069065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.069740 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.071552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1324/2661] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:48 2022] DELETE /identity/v3/projects/275155aafa41471196e48de63322e0b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:49.075587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:49.085550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514d867-1d0a-48d8-ae79-ddb7e329e236 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:49.147526 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:49.148398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.148675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.148947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] PATH_INFO: `/v3/users/c8d12fe2cb21443aacc52bee29a68888` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.150147 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d12fe2cb21443aacc52bee29a68888)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:49.152071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:49.197898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d12fe2cb21443aacc52bee29a68888'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.206327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d12fe2cb21443aacc52bee29a68888'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.218728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d12fe2cb21443aacc52bee29a68888'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.219455 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d12fe2cb21443aacc52bee29a68888'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.220137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-84d8a49c-81fb-4987-922a-86a61971c25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d12fe2cb21443aacc52bee29a68888'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.232652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1338/2662] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:49 2022] DELETE /identity/v3/users/c8d12fe2cb21443aacc52bee29a68888 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:49.505062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:49.506603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:49.520150 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78cda-275a-4824-9f56-05a3bb99e881 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:49.579509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:49.580446 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.580729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.581030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] PATH_INFO: `/v3/projects/b4c2dc603c3242b68e782564908aac1e` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.582305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c2dc603c3242b68e782564908aac1e)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:49.584279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:49.645507 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c2dc603c3242b68e782564908aac1e', 'request_id': 'req-9b682b83-4851-4846-8348-d28ade62410a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.651384 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c2dc603c3242b68e782564908aac1e', 'request_id': 'req-9b682b83-4851-4846-8348-d28ade62410a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.657796 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c2dc603c3242b68e782564908aac1e', 'request_id': 'req-9b682b83-4851-4846-8348-d28ade62410a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.672580 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] The token cache is being invalidate because project b4c2dc603c3242b68e782564908aac1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:49.672895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.673553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9b682b83-4851-4846-8348-d28ade62410a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:49.675191 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1325/2663] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:49 2022] DELETE /identity/v3/projects/b4c2dc603c3242b68e782564908aac1e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:15:49.682990 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.683475 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.683589 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.708723 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:49.709912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:49.773176 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1339/2664] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:49.781501 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.781799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.782055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.805342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:49.806560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:49.816280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1326/2665] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:49.820752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:49.830720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ec312-c401-4c3a-8073-1d5f56f31fbf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:49.836157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:49.836810 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.837090 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.837365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.838089 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:15:49.838400 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:49.840047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:49.851725 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1340/2666] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:15:49.855937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:49.865229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03079b-1972-4958-a1f7-108a5ca7739e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:49.870122 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:49.870808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.871092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.871370 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.872107 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:49.874017 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:49.900059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1327/2667] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:49 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:15:49.905644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:49.920653 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aabde8-025e-4f84-9d85-e2705789358e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:49.975976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:49.976642 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:49.976921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:49.977299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:49.977981 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:49.979976 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.001600 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1341/2668] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:49 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:50.006050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.016670 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959744e1-7507-4957-8e42-a7573f06a613 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.022054 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.022741 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.023026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.023302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.024026 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.025623 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.036066 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1328/2669] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:15:50.040158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.050686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3852-3623-4440-a29f-9f0fdb4af596 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.056565 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.057219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.057506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.057882 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.058613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.060289 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee37df-ff0f-425c-b0eb-61fd5b632f4d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.071059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1342/2670] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:15:50.075567 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.086004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899bf87-4f86-475d-80c6-dddcf5c6ce5b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.091917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.092797 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.093070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.093352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] PATH_INFO: `/v3/projects/3923f511c31f4d9888ecd388803d7ee8/users/42ee30a18652410694730761dcb69af1/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.109106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3923f511c31f4d9888ecd388803d7ee8, user_id=42ee30a18652410694730761dcb69af1, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.111785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.127475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1329/2671] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:50 2022] PUT /identity/v3/projects/3923f511c31f4d9888ecd388803d7ee8/users/42ee30a18652410694730761dcb69af1/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:50.142100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.142414 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.142791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.170977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] MFA Rules not processed for user `42ee30a18652410694730761dcb69af1`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:50.172110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:50.237915 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1343/2672] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:50.242460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.305690 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c203242-6b6f-40c5-b134-7c38b67be281 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.310955 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.311603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.311881 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.312152 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.312832 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.314752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.342871 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1330/2673] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:50.348987 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.363325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5c6e-6bdd-4462-805a-5289023b9ac1 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.419687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.420333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.420615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.420892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.421640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.423532 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.443517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1344/2674] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:50 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:50.447792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.458500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbcf9-d91a-43e7-a5d1-e9315d6894d3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.464344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.464999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.465279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.465547 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.466267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.467866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.478705 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1331/2675] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:15:50.483185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.493807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead904c-28fc-49d3-9075-06689be39dc4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.499626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.500517 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.500804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.501072 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] PATH_INFO: `/v3/projects/357b39d13f1f48e488ebd619a6bcef2d/users/c4e53b9eb16e4bbabe64d7686f13932b/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.516974 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357b39d13f1f48e488ebd619a6bcef2d, user_id=c4e53b9eb16e4bbabe64d7686f13932b, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.519674 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.533967 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1345/2676] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:50 2022] PUT /identity/v3/projects/357b39d13f1f48e488ebd619a6bcef2d/users/c4e53b9eb16e4bbabe64d7686f13932b/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:50.538064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.548605 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c97786-1f80-4f2a-8656-1bae99a68a3c admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.606343 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.607072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.607355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.607630 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.608355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.609991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089207a-6703-421e-b9db-b75d128b2d51 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.620148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1332/2677] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:15:50.624566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.635243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e839-4b3a-4ef4-b744-d768a86caa89 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.641347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.642238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.642516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.642806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] PATH_INFO: `/v3/projects/357b39d13f1f48e488ebd619a6bcef2d/users/c4e53b9eb16e4bbabe64d7686f13932b/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.644837 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=357b39d13f1f48e488ebd619a6bcef2d, user_id=c4e53b9eb16e4bbabe64d7686f13932b, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.647512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.658044 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1346/2678] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:50 2022] PUT /identity/v3/projects/357b39d13f1f48e488ebd619a6bcef2d/users/c4e53b9eb16e4bbabe64d7686f13932b/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:50.668906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.669199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.669544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.697217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] MFA Rules not processed for user `c4e53b9eb16e4bbabe64d7686f13932b`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:50.698362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:50.783096 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1333/2679] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:50.795807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:50.798131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:50.856243 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac96a-370b-4e73-ba5e-636eb195bf85 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:50.860269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:50.860934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:50.861191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:50.861491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:50.870690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:50.872153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7adff5-bd77-43d4-b0f7-3ca24114e5a3 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:50.884130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1347/2680] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:50.948282 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:51.017751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2a46-e83a-4642-9233-01137ed00621 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:51.024002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:51.024906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:51.025195 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:51.025467 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] PATH_INFO: `/v3/users/42ee30a18652410694730761dcb69af1` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:51.026953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ee30a18652410694730761dcb69af1)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:51.028970 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:51.079885 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ee30a18652410694730761dcb69af1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.080539 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ee30a18652410694730761dcb69af1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.088865 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ee30a18652410694730761dcb69af1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.106421 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ee30a18652410694730761dcb69af1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.113544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ee30a18652410694730761dcb69af1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.119573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1334/2681] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:50 2022] DELETE /identity/v3/users/42ee30a18652410694730761dcb69af1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:51.124293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:51.124576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:51.124856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:51.144110 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:51.145314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:51.208256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1348/2682] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:51.222269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:51.222269 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:51.295357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce701f7-ef15-4013-957f-d725e8fbd8fd admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:51.300002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:51.300660 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:51.300940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:51.301209 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:51.316042 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:51.318147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:51.330312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1335/2683] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 01 10:15:51.604337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:51.605878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:51.618766 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e795bc-3643-4b77-a90c-4f96dd083758 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:51.623944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:51.624806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:51.625083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:51.625357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] PATH_INFO: `/v3/projects/3923f511c31f4d9888ecd388803d7ee8` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:51.626680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3923f511c31f4d9888ecd388803d7ee8)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:51.628726 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:51.677049 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3923f511c31f4d9888ecd388803d7ee8', 'request_id': 'req-26edc702-b54c-40dd-b39a-4679a918cf6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.682165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3923f511c31f4d9888ecd388803d7ee8', 'request_id': 'req-26edc702-b54c-40dd-b39a-4679a918cf6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.688190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3923f511c31f4d9888ecd388803d7ee8', 'request_id': 'req-26edc702-b54c-40dd-b39a-4679a918cf6f'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.702167 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] The token cache is being invalidate because project 3923f511c31f4d9888ecd388803d7ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:51.702470 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.703107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.704797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1349/2684] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:51 2022] DELETE /identity/v3/projects/3923f511c31f4d9888ecd388803d7ee8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:51.709038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:51.718993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5fc47-0f35-49a4-9314-187983218d50 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:51.781397 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:51.782573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:51.782866 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:51.783160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] PATH_INFO: `/v3/users/c4e53b9eb16e4bbabe64d7686f13932b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:51.784616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e53b9eb16e4bbabe64d7686f13932b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:51.786769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:51.838668 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e53b9eb16e4bbabe64d7686f13932b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.839364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e53b9eb16e4bbabe64d7686f13932b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.849109 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e53b9eb16e4bbabe64d7686f13932b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.861234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e53b9eb16e4bbabe64d7686f13932b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.868040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8dd9229f-7321-4f19-90ad-0c1fbe2a54f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e53b9eb16e4bbabe64d7686f13932b'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:51.873974 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1336/2685] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:51 2022] DELETE /identity/v3/users/c4e53b9eb16e4bbabe64d7686f13932b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:52.148993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.150596 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:52.163670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc702-b54c-40dd-b39a-4679a918cf6f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.221849 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.222639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.222951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.223225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] PATH_INFO: `/v3/projects/357b39d13f1f48e488ebd619a6bcef2d` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.224450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=357b39d13f1f48e488ebd619a6bcef2d)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.226364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.277459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '357b39d13f1f48e488ebd619a6bcef2d', 'request_id': 'req-8f8b1f91-1341-4509-9078-1d1a0220c65a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:52.283287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '357b39d13f1f48e488ebd619a6bcef2d', 'request_id': 'req-8f8b1f91-1341-4509-9078-1d1a0220c65a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:52.289979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '357b39d13f1f48e488ebd619a6bcef2d', 'request_id': 'req-8f8b1f91-1341-4509-9078-1d1a0220c65a'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:52.306194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] The token cache is being invalidate because project 357b39d13f1f48e488ebd619a6bcef2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:52.306783 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:52.307519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-8f8b1f91-1341-4509-9078-1d1a0220c65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:52.313683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1350/2686] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:52 2022] DELETE /identity/v3/projects/357b39d13f1f48e488ebd619a6bcef2d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:15:52.315656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.315953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.316249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.335525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:52.336842 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:52.399603 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1337/2687] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:52.409391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.409682 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.409960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.428872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:52.430079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:52.438662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1351/2688] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:15:52.443074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.453841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3ef3a-15e1-4bfe-9af7-6d618ad39936 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.459754 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.460404 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.460684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.460930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.461667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:15:52.461969 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.463608 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.475821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1338/2689] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:15:52.480238 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.489902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eecc-4da4-43cd-bed3-0aef146b7e9f None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.495897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.496571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.496855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.497131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.497821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.499847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.535686 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1352/2690] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:52.539756 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.550121 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9534b58-93fc-4488-be4e-ad251915d139 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.619293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.620058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.620340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.620679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.621487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.623495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.649402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1339/2691] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:52.655715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.669826 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7246843-aaa7-4040-b18d-9f2a26f09539 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.675577 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.676242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.676522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.676919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.677650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.679263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.689916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1353/2692] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:52.693958 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.704030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da52d2-ef95-4b09-aa71-766916735be1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.709157 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.709767 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.710085 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.710363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.711099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.712684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b8e53-e48e-4937-b93a-dc5dcd864eed admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.723074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1340/2693] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:52.727549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.737978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cde99-f734-4c8d-8f7d-d0992d5c416b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.743203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.744105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.744390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.744689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] PATH_INFO: `/v3/projects/a9e5689f0ec049fa88ee523ddd40e9bd/users/c0692505ca4540d1902bc3a17343c976/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.759373 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e5689f0ec049fa88ee523ddd40e9bd, user_id=c0692505ca4540d1902bc3a17343c976, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.762016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:52.779650 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1354/2694] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:52 2022] PUT /identity/v3/projects/a9e5689f0ec049fa88ee523ddd40e9bd/users/c0692505ca4540d1902bc3a17343c976/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:52.796187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.796480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.796786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.822790 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] MFA Rules not processed for user `c0692505ca4540d1902bc3a17343c976`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:52.824014 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:52.898557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1341/2695] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:52.906085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:52.979388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b85e3-6a3e-4022-b76e-fa493885ba2c admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:52.985404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:52.986064 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:52.986337 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:52.986607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:52.987318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:52.989225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.018390 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1355/2696] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:52 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:53.022525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.033451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e64f3d-9ee3-4b03-9104-dd812d1ebfd4 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.091250 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.091939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.092222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.092496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.093196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.095280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.120133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1342/2697] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:53 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:53.125867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.136305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba86f6-7eb8-4381-9086-e1ba35a2b1a0 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.141548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.142208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.142496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.142815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.143549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.145159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.155692 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1356/2698] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:53.159765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.169733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1593770-5662-4840-840f-8cfaf25ded3f admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.174831 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.175714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.176022 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.176291 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] PATH_INFO: `/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554/users/7c56828e445d4e55b9eda0880d4117eb/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.192548 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c4c2fe64e4a4e8002a95db9f7e554, user_id=7c56828e445d4e55b9eda0880d4117eb, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.195284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.214366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1343/2699] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:53 2022] PUT /identity/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554/users/7c56828e445d4e55b9eda0880d4117eb/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:53.219145 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.229364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5495d1c-465c-492e-be54-979dcc3a0d98 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.286545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.287155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.287434 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.287712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.288465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.290079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1f540-03e0-4c07-bb4c-9578d66c2a46 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.300300 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1357/2700] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:53.304737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.315392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a3c16-b151-4136-9df1-d91b679ebd1d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.320828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.321760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.322037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.322307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] PATH_INFO: `/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554/users/7c56828e445d4e55b9eda0880d4117eb/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.324520 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c4c2fe64e4a4e8002a95db9f7e554, user_id=7c56828e445d4e55b9eda0880d4117eb, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.327215 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.338436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1344/2701] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:53 2022] PUT /identity/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554/users/7c56828e445d4e55b9eda0880d4117eb/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:15:53.349739 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.350030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.350304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.377956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] MFA Rules not processed for user `7c56828e445d4e55b9eda0880d4117eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:53.379219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:53.449946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1358/2702] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:53.462464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:53.464432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:53.526599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e8d2-8fba-4d9c-9f41-327f1e7bc46b admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:53.531425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:53.532101 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:53.532382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:53.532648 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:53.542663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:53.544069 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf24a-7f33-4fac-a55b-68af2e327682 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:53.553823 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1345/2703] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:54.100707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:54.163030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440bd1-9196-4c4e-a2fd-17361288cbf8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:54.169206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:54.170083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:54.170364 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:54.170637 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] PATH_INFO: `/v3/users/c0692505ca4540d1902bc3a17343c976` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:54.172055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0692505ca4540d1902bc3a17343c976)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:54.174053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:54.228207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0692505ca4540d1902bc3a17343c976'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.239807 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0692505ca4540d1902bc3a17343c976'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.252897 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0692505ca4540d1902bc3a17343c976'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.253609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0692505ca4540d1902bc3a17343c976'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.254279 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0692505ca4540d1902bc3a17343c976'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.267643 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1359/2704] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:54 2022] DELETE /identity/v3/users/c0692505ca4540d1902bc3a17343c976 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:54.272382 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:54.272854 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:54.272949 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:54.290669 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:54.291841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:54.352473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1346/2705] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:54.362673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:54.364139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:54.427211 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382465d1-992e-482c-9724-8b0accdd7049 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:54.433802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:54.434741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:54.435080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:54.435441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:54.445701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:54.447179 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:54.456576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1360/2706] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:54.725088 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:54.726569 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:54.738556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e8084-5692-4f99-b9e8-5df03f7c3b49 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:54.743471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:54.744344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:54.744643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:54.744946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] PATH_INFO: `/v3/projects/a9e5689f0ec049fa88ee523ddd40e9bd` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:54.746167 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e5689f0ec049fa88ee523ddd40e9bd)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:54.748093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:54.801876 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e5689f0ec049fa88ee523ddd40e9bd', 'request_id': 'req-8cc7abca-8e5d-445d-923f-4083c6686ffb'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.809803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e5689f0ec049fa88ee523ddd40e9bd', 'request_id': 'req-8cc7abca-8e5d-445d-923f-4083c6686ffb'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.819016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e5689f0ec049fa88ee523ddd40e9bd', 'request_id': 'req-8cc7abca-8e5d-445d-923f-4083c6686ffb'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.834906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] The token cache is being invalidate because project a9e5689f0ec049fa88ee523ddd40e9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:54.835185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.835813 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.837348 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1347/2707] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:54 2022] DELETE /identity/v3/projects/a9e5689f0ec049fa88ee523ddd40e9bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:54.841432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:54.851015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ff05-6757-4d5b-bef2-0889a559f914 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:54.909077 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:54.909947 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:54.910255 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:54.910528 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] PATH_INFO: `/v3/users/7c56828e445d4e55b9eda0880d4117eb` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:54.911895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c56828e445d4e55b9eda0880d4117eb)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:54.913833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:54.968371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c56828e445d4e55b9eda0880d4117eb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.979904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c56828e445d4e55b9eda0880d4117eb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.993296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c56828e445d4e55b9eda0880d4117eb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.993937 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c56828e445d4e55b9eda0880d4117eb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:54.994555 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b06ad6f1-6770-4902-a638-b7e538cc9848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c56828e445d4e55b9eda0880d4117eb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.007459 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1361/2708] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:15:54 2022] DELETE /identity/v3/users/7c56828e445d4e55b9eda0880d4117eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:55.276406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.277944 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:55.290622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7abca-8e5d-445d-923f-4083c6686ffb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.346597 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.347495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.347777 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.348052 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] PATH_INFO: `/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.349303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760c4c2fe64e4a4e8002a95db9f7e554)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.351254 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.401213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760c4c2fe64e4a4e8002a95db9f7e554', 'request_id': 'req-2728b7cd-6932-4bf4-b1c0-147183389ff0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.406952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760c4c2fe64e4a4e8002a95db9f7e554', 'request_id': 'req-2728b7cd-6932-4bf4-b1c0-147183389ff0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.412975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760c4c2fe64e4a4e8002a95db9f7e554', 'request_id': 'req-2728b7cd-6932-4bf4-b1c0-147183389ff0'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.425205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] The token cache is being invalidate because project 760c4c2fe64e4a4e8002a95db9f7e554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:15:55.425487 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.426094 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2728b7cd-6932-4bf4-b1c0-147183389ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:15:55.427639 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1348/2709] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:15:55 2022] DELETE /identity/v3/projects/760c4c2fe64e4a4e8002a95db9f7e554 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:55.432730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.433206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.433374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.452562 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:55.453768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:55.509522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1362/2710] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:55.518990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.519328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.519733 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.548137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:55.549345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:55.558870 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1349/2711] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:55.563388 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.573519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f5dc1-f0cc-464c-8a26-bd0941e472f6 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.579150 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.579815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.580104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.580377 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.581100 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:15:55.581405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.583047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.594342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1363/2712] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:15:55.598834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.610337 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c474e-b1e9-471c-becc-44ce6e6de2c8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.616207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.616824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.617108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.617376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.618056 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.619989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.648480 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1350/2713] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:55.652774 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.662955 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe07ba-f526-473d-a6cb-1057a5348dce admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.717936 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.718737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.719093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.719402 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.720083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.722029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.742965 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1364/2714] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:55.747106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.757544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50545ef-97ff-4b57-9cd1-ba071ab07cbe admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.763068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.763732 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.764021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.764637 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.765364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.767089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.777665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1351/2715] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:55.781572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.792314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99f4f4-1c80-4e8d-8b56-3b33313a521d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.797789 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.798482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.798805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.799104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.799827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.801391 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9fd7b-de96-4519-9960-42a4c58f12d8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.811432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1365/2716] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:15:55.815917 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:55.826322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dde52c-bd7a-4948-98dc-a42af9df7538 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:55.831301 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:55.832172 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.832451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.832744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] PATH_INFO: `/v3/projects/3877a08d271249a98c3cdf31746a3b13/users/3d682b9435534cf493662e2aa0c86fc7/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.847728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3877a08d271249a98c3cdf31746a3b13, user_id=3d682b9435534cf493662e2aa0c86fc7, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:55.850347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:55.864452 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1352/2717] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:55 2022] PUT /identity/v3/projects/3877a08d271249a98c3cdf31746a3b13/users/3d682b9435534cf493662e2aa0c86fc7/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:55.874711 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:55.875039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:55.875398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:55.903274 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] MFA Rules not processed for user `3d682b9435534cf493662e2aa0c86fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:55.904514 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:55.979877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1366/2718] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:55.984576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.053907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa398d6-0d52-4529-a3a7-c5fc76a077ba admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.060708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.061659 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.062027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.062392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.063176 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.065097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.091629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1353/2719] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:55 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:56.096153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.107593 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e435-97c5-434c-814e-1ac89d2bf896 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.162022 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.162688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.162999 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.163245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.163942 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.165860 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.188554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1367/2720] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:56 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:56.192755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.203534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020aa2ca-8ab4-48f1-9417-d1fc95b9c8dd admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.209380 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.210074 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.210376 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.210629 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.211474 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.213407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.224053 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1354/2721] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:56.228013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.238003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e85565-f53f-4bb2-b688-b8c3d719b250 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.242798 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.243450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.243737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.244012 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.244738 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.246320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fc29b-b451-479e-854a-b809ab7b5f01 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.256567 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1368/2722] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:56.260511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.271221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab273c-cb6f-4d6d-a09b-048ccfbc0a33 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.276270 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.277143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.277725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.277725 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] PATH_INFO: `/v3/projects/ed5b61a2217e4988a6206c8ac73412d4/users/c1710f57abac40049706e211c05b2e8a/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.294357 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5b61a2217e4988a6206c8ac73412d4, user_id=c1710f57abac40049706e211c05b2e8a, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.297018 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.313373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1355/2723] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:56 2022] PUT /identity/v3/projects/ed5b61a2217e4988a6206c8ac73412d4/users/c1710f57abac40049706e211c05b2e8a/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:56.376598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.376836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.377151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.406538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] MFA Rules not processed for user `c1710f57abac40049706e211c05b2e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:56.407778 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:56.478002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1369/2724] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:56.482815 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.543509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53fa08-2223-429b-8cc6-d7f2ea94a557 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.548798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.549451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.549734 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.550011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.550680 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.552613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.580601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1356/2725] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:15:56 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:56.584878 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.596013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893efca-47db-48ee-b4a6-45f8411169cf None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.650185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.650886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.651165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.651436 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.652127 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.654050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.676359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1370/2726] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:15:56 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:15:56.680451 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.690927 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98fd6a-0060-414e-b57f-45ad7fd91483 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.695658 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.696322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.696604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.696863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.697600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.699217 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.709616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1357/2727] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:56.714245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.725154 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95273a83-d12a-478a-9256-5dbf4b692027 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.730265 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.731197 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.731476 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.731751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] PATH_INFO: `/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf/users/c16ea716e75247c3a7d54ba1d2aa6500/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.746928 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee4c9ae9414cbbbb4985f19fb58baf, user_id=c16ea716e75247c3a7d54ba1d2aa6500, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.749502 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.765341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1371/2728] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:56 2022] PUT /identity/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf/users/c16ea716e75247c3a7d54ba1d2aa6500/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:56.769465 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.779568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823317d5-440d-4956-ae9d-2e9a43dd8ee5 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.838594 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.839319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.839599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.839863 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.840601 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.842229 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f632d-3b06-48c4-a1fa-9c74db93cc3e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.852320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1358/2729] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:15:56.856645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:56.866939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbcbe-a9c7-4677-830c-d171086e62ed admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:56.871866 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:56.872769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.873045 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.873316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] PATH_INFO: `/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf/users/c16ea716e75247c3a7d54ba1d2aa6500/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.875421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ee4c9ae9414cbbbb4985f19fb58baf, user_id=c16ea716e75247c3a7d54ba1d2aa6500, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:56.878129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:56.888927 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1372/2730] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:15:56 2022] PUT /identity/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf/users/c16ea716e75247c3a7d54ba1d2aa6500/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:15:56.899313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:56.899621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:56.899879 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:56.928188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] MFA Rules not processed for user `c16ea716e75247c3a7d54ba1d2aa6500`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:15:56.929408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:57.019093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1359/2731] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:15:57.031887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:57.035102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:57.100457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2207-859e-4747-8696-2bed0e29dd4d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:57.104844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:57.105491 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:57.105751 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:57.106048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:57.161208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:57.162629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:57.171439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1373/2732] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:58.680622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:58.682261 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:15:58.694821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d1fe6-74a5-406f-b0b6-001839fb0c1f None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:58.698663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:58.699319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:58.699606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:58.699884 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:58.764907 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:58.766284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:58.775787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1360/2733] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:15:59.297142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:15:59.306842 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0859bd-1108-49ac-9f60-2c15663f2280 service cinder] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:15:59.311368 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:15:59.312041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:15:59.312318 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:15:59.312591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:15:59.322838 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:15:59.324431 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea19a5-86cd-414f-aa9b-0effa2a1c2a6 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:15:59.334456 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1374/2734] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:16:03.202240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:03.266674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286c5a1-46d5-4335-9286-013590d6d127 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:03.271574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:03.272460 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:03.272749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:03.273011 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] PATH_INFO: `/v3/users/3d682b9435534cf493662e2aa0c86fc7` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:03.274212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d682b9435534cf493662e2aa0c86fc7)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:03.276170 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:03.330611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d682b9435534cf493662e2aa0c86fc7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.331333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d682b9435534cf493662e2aa0c86fc7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.341127 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d682b9435534cf493662e2aa0c86fc7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.354030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d682b9435534cf493662e2aa0c86fc7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.360926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d682b9435534cf493662e2aa0c86fc7'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.367442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1361/2735] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:16:03 2022] DELETE /identity/v3/users/3d682b9435534cf493662e2aa0c86fc7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:03.372267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:03.372801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:03.372801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:03.391639 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:16:03.392869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:03.450351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1375/2736] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:16:03.463769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:03.465532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:03.529739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8567f17-8dbd-48f2-aa89-df41f175457d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:03.534299 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:03.535043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:03.535327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:03.535607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:03.544689 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:03.546133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:03.555526 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1362/2737] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:16:03.833196 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:03.834757 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:03.847039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678894c1-af55-4b4e-8dcd-2a529b898b94 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:03.852701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:03.853885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:03.854054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:03.854408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] PATH_INFO: `/v3/projects/3877a08d271249a98c3cdf31746a3b13` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:03.855746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3877a08d271249a98c3cdf31746a3b13)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:03.857699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:03.904886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3877a08d271249a98c3cdf31746a3b13', 'request_id': 'req-97d37f9f-8973-43d7-9730-71531e9bbdb6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.910519 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3877a08d271249a98c3cdf31746a3b13', 'request_id': 'req-97d37f9f-8973-43d7-9730-71531e9bbdb6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.916799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3877a08d271249a98c3cdf31746a3b13', 'request_id': 'req-97d37f9f-8973-43d7-9730-71531e9bbdb6'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.931168 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] The token cache is being invalidate because project 3877a08d271249a98c3cdf31746a3b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:16:03.931452 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.932105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:03.933707 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1376/2738] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:16:03 2022] DELETE /identity/v3/projects/3877a08d271249a98c3cdf31746a3b13 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:03.937882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:03.947599 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd67166-b6a5-41b0-ba0a-7346e3714ea7 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:04.015912 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:04.017181 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:04.017619 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:04.018062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] PATH_INFO: `/v3/users/c1710f57abac40049706e211c05b2e8a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:04.019943 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1710f57abac40049706e211c05b2e8a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:04.021898 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:04.073711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1710f57abac40049706e211c05b2e8a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.074390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1710f57abac40049706e211c05b2e8a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.083968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1710f57abac40049706e211c05b2e8a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.096801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1710f57abac40049706e211c05b2e8a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.103711 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1710f57abac40049706e211c05b2e8a'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.109715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1363/2739] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:16:03 2022] DELETE /identity/v3/users/c1710f57abac40049706e211c05b2e8a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:04.376811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:04.378423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:04.391920 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37f9f-8973-43d7-9730-71531e9bbdb6 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:04.450228 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:04.451155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:04.451443 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:04.451730 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] PATH_INFO: `/v3/projects/ed5b61a2217e4988a6206c8ac73412d4` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:04.453024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5b61a2217e4988a6206c8ac73412d4)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:04.455039 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:04.502787 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5b61a2217e4988a6206c8ac73412d4', 'request_id': 'req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.508408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5b61a2217e4988a6206c8ac73412d4', 'request_id': 'req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.514886 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5b61a2217e4988a6206c8ac73412d4', 'request_id': 'req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.529328 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] The token cache is being invalidate because project ed5b61a2217e4988a6206c8ac73412d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:16:04.529615 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.530240 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.531853 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1377/2740] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:16:04 2022] DELETE /identity/v3/projects/ed5b61a2217e4988a6206c8ac73412d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:04.535988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:04.537387 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:04.549971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ef990-e2a6-4d36-8a53-69248a723773 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:04.613551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:04.614459 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:04.614772 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:04.615058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] PATH_INFO: `/v3/users/c16ea716e75247c3a7d54ba1d2aa6500` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:04.616361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16ea716e75247c3a7d54ba1d2aa6500)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:04.618320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:04.668604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16ea716e75247c3a7d54ba1d2aa6500'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.669354 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16ea716e75247c3a7d54ba1d2aa6500'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.679100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16ea716e75247c3a7d54ba1d2aa6500'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.690942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16ea716e75247c3a7d54ba1d2aa6500'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.697568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-7931b4e6-7276-42e2-b7e6-34f8de51455b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16ea716e75247c3a7d54ba1d2aa6500'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:04.703409 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1364/2741] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:16:04 2022] DELETE /identity/v3/users/c16ea716e75247c3a7d54ba1d2aa6500 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:04.992962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:04.994450 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:05.009182 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8239ac-e436-4f5e-8008-fdf4528c9ce2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:05.065369 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:05.066190 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:05.066474 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:05.066777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] PATH_INFO: `/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:05.068021 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ee4c9ae9414cbbbb4985f19fb58baf)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:05.069929 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:05.117315 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ee4c9ae9414cbbbb4985f19fb58baf', 'request_id': 'req-3b6aec01-f769-4a5d-bc7b-66a369351124'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:05.122793 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ee4c9ae9414cbbbb4985f19fb58baf', 'request_id': 'req-3b6aec01-f769-4a5d-bc7b-66a369351124'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:05.130136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ee4c9ae9414cbbbb4985f19fb58baf', 'request_id': 'req-3b6aec01-f769-4a5d-bc7b-66a369351124'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:05.146052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] The token cache is being invalidate because project e2ee4c9ae9414cbbbb4985f19fb58baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:16:05.146344 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:05.147056 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:16:05.148811 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1378/2742] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:16:04 2022] DELETE /identity/v3/projects/e2ee4c9ae9414cbbbb4985f19fb58baf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:16:10.776887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:10.777405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:10.777405 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:10.796586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] MFA Rules not processed for user `dc4e99689ba54f67bce199ca2779c331`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:16:10.797792 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:10.855037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1365/2743] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:16:11.180546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:11.182116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:11.238956 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6aec01-f769-4a5d-bc7b-66a369351124 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:11.243020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:11.243670 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:11.243962 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:11.244231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:11.246139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:11.255737 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:11.257199 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:11.265776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1379/2744] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:16:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:16:11.620681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:11.622216 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:11.694961 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c73a8-7ed8-45e8-b343-a1ebf26e80c8 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:11.700564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:11.701230 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:11.701519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:11.701789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:11.703722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:11.715307 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:11.716872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:11.729968 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1366/2745] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:16:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:16:20.145467 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:16:20.147142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:20.264430 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfc169-db28-463c-b31c-2e513bc2d3fc service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:16:20.271136 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:16:20.271781 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:16:20.272085 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:16:20.272341 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:16:20.274109 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:16:20.285870 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:16:20.287505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66481137-2d14-41df-8eec-1d7d2dea290b service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:16:20.297731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1380/2746] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:17:16.640940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:17:16.643302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:17:16.733883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69dcc-1ad7-429a-be24-556cadfaf13d service placement] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:17:16.744221 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:17:16.745169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:17:16.745591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:17:16.745894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:17:16.749067 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:17:16.763600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:17:16.765168 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:17:16.775264 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1367/2747] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:17:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:17:50.039772 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:17:50.040321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:17:50.040421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:17:50.058251 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] MFA Rules not processed for user `dc4e99689ba54f67bce199ca2779c331`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:17:50.059492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:17:50.066546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1381/2748] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:19:07.531785 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:19:07.533418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:07.580712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73b19-ea24-4917-b594-aed3c2687784 service placement] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:19:07.588568 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:19:07.589249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:07.589555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:07.589835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:07.591989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:07.603284 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:19:07.604860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:19:07.614050 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1368/2749] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:19:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:19:09.027994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:19:09.029715 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:09.110511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8ffaa-903a-4223-9012-a9cbcca97723 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:19:09.114583 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:19:09.115281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:09.115568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:09.115841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:09.117830 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:09.131622 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:19:09.133052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aff22-184a-4b12-bb6f-1e56d1ef1474 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:19:09.144283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1382/2750] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:19:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:19:16.953131 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:19:16.954631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:16.968203 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a893a-d14a-4df5-9714-18c6af1ff087 service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:19:16.974847 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:19:16.975737 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:16.976099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:16.976373 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:16.979239 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:16.999746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:19:17.001156 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:19:17.012292 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1369/2751] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:19:24.245290 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:24.245855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:24.245855 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:24.273432 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] MFA Rules not processed for user `dc4e99689ba54f67bce199ca2779c331`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:19:24.274689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:24.282844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1383/2752] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:19:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:19:24.618048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:19:24.620402 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:24.663263 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a41-5a2a-4871-b3a8-b17a4540a1e8 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:19:24.667511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:19:24.668208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:24.668473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:24.668751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:24.670638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:24.680986 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:19:24.682434 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:19:24.691328 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1370/2753] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:19:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:19:37.014689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:19:37.031538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e8b6-d49e-440f-8786-f3c161280a4c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:19:37.038015 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:19:37.038777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:19:37.039130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:19:37.039496 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:19:37.041499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:19:37.056038 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:19:37.057768 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:19:37.070296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1384/2754] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:19:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:20:21.295713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:20:21.304996 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26a3a-26d2-4cba-92e1-fa815f4c3d57 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:20:21.309808 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:20:21.310455 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:20:21.310846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:20:21.311124 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:20:21.313258 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:20:21.323757 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:20:21.325212 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:20:21.333590 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1371/2755] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:20:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:20:55.449744 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:20:55.464052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cd64-f4d7-444c-bc71-3d104e814732 service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:20:55.472143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:20:55.473205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:20:55.473656 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:20:55.474108 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:20:55.477139 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:20:55.494546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:20:55.495678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:20:55.508232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1385/2756] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:20:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:00.602422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:00.611994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50076-6030-428f-9b21-382c491bbb89 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:00.616199 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:00.616856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:00.617143 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:00.617418 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:00.619360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:00.706345 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:00.707828 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:00.727574 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1372/2757] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:03.985998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:03.987588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:04.001112 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72021b4a-38da-42f7-97c2-d6990d4f98dc service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.005912 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.006832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.007116 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.007386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] PATH_INFO: `/v3/users/dc4e99689ba54f67bce199ca2779c331` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.008576 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4e99689ba54f67bce199ca2779c331)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.010478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.073441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4e99689ba54f67bce199ca2779c331'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.083230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4e99689ba54f67bce199ca2779c331'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.095561 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4e99689ba54f67bce199ca2779c331'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.096231 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4e99689ba54f67bce199ca2779c331'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.096901 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-0ebd9efa-384e-4d63-8331-4bd3f7f4a994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4e99689ba54f67bce199ca2779c331'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.108769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1386/2758] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:03 2022] DELETE /identity/v3/users/dc4e99689ba54f67bce199ca2779c331 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:04.288048 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.298498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038da1af-8b99-4208-a566-1f4498887d20 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.361225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.362105 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.362390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.362695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] PATH_INFO: `/v3/projects/1e8c16b8e2564e468f11fb0bfdade484` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.363937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8c16b8e2564e468f11fb0bfdade484)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.365882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.414424 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8c16b8e2564e468f11fb0bfdade484', 'request_id': 'req-1e3adea0-fc55-4747-8a61-56d286ec1126'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.419860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8c16b8e2564e468f11fb0bfdade484', 'request_id': 'req-1e3adea0-fc55-4747-8a61-56d286ec1126'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.425820 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8c16b8e2564e468f11fb0bfdade484', 'request_id': 'req-1e3adea0-fc55-4747-8a61-56d286ec1126'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.444064 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] The token cache is being invalidate because project 1e8c16b8e2564e468f11fb0bfdade484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:04.444347 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.445356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1e3adea0-fc55-4747-8a61-56d286ec1126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:04.447519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1373/2759] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:04 2022] DELETE /identity/v3/projects/1e8c16b8e2564e468f11fb0bfdade484 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:04.453269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.453568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.453832 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.510053 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:04.511311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:04.571138 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1387/2760] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:04.579047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.579341 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.579646 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.598340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:04.599584 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:04.608232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1374/2761] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:04.612977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.628314 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10a133-ebba-42a1-b9ae-6d4b0a3b1d73 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.636806 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.637466 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.637748 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.638018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.638847 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:04.639155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.640760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.653119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1388/2762] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:04.657276 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.666406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7de4d-fe47-4cbe-857e-59e3df07588d None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.671587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.672226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.672518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.672787 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.673505 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.675499 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.703349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1375/2763] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:04.708107 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.718917 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5299f-0784-4087-86b2-211ff27b2cca admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.783898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.784575 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.784859 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.785134 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.785827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.787782 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.813071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1389/2764] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:04 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:04.817413 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.828248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad194798-b775-4e07-918c-feed9e5662f1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.833013 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.833678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.833962 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.834234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.834999 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.836591 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.847142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1376/2765] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:04.853079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.866729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab6b9-a7a2-4294-9516-d242933e5a3a admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.872013 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.872720 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.873001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.873270 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.873989 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.875623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883a65b-5c3c-4228-a550-93da2fbe308d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.886493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1390/2766] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:04.891708 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:04.903960 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd995f-1510-4001-afd1-f761be105232 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:04.909914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:04.910834 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.911102 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.911415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] PATH_INFO: `/v3/projects/a46b0dfbc5bc4d4697ca625f4b5ced2b/users/490f21d012a040f7b66c5e4fef952305/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.927618 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46b0dfbc5bc4d4697ca625f4b5ced2b, user_id=490f21d012a040f7b66c5e4fef952305, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:04.930419 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:04.945470 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1377/2767] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:04 2022] PUT /identity/v3/projects/a46b0dfbc5bc4d4697ca625f4b5ced2b/users/490f21d012a040f7b66c5e4fef952305/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:04.956102 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:04.956437 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:04.956712 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:04.990062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] MFA Rules not processed for user `490f21d012a040f7b66c5e4fef952305`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:04.991286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:05.054003 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1391/2768] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:05.066234 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:05.068473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:05.151139 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c522a3-8ab5-41e1-b16e-561ec49e7527 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:05.157314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:05.157965 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:05.158252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:05.158525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:05.166846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:05.168571 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5d00-c3f2-4636-a696-ebc2d4a4a4ba service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:05.180142 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1378/2769] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:13.524316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:13.588386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c52bc3-ac1f-44b0-b7ab-1ec6064bf459 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:13.593273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:13.594184 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:13.594465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:13.594761 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] PATH_INFO: `/v3/users/490f21d012a040f7b66c5e4fef952305` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:13.595935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=490f21d012a040f7b66c5e4fef952305)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:13.597841 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:13.648598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490f21d012a040f7b66c5e4fef952305'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:13.656592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490f21d012a040f7b66c5e4fef952305'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:13.668129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490f21d012a040f7b66c5e4fef952305'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:13.668776 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490f21d012a040f7b66c5e4fef952305'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:13.669392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490f21d012a040f7b66c5e4fef952305'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:13.681175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1392/2770] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:13 2022] DELETE /identity/v3/users/490f21d012a040f7b66c5e4fef952305 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:13.686023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:13.686513 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:13.686611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:13.705290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:13.706496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:13.770079 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1379/2771] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:13.780020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:13.781468 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:13.838497 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de52e9-929f-4fc9-bbba-177729d31ebd admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:13.843335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:13.844004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:13.844282 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:13.844729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:13.860747 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:13.862319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8838cf-263b-4137-bae1-9fae715a30e6 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:13.872333 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1393/2772] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:14.141751 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.143385 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:14.158727 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f60b7-eee9-4f93-89c1-12bc8e71797e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.163023 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.164775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.165110 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.165356 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] PATH_INFO: `/v3/projects/a46b0dfbc5bc4d4697ca625f4b5ced2b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.166942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46b0dfbc5bc4d4697ca625f4b5ced2b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.169006 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.216665 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46b0dfbc5bc4d4697ca625f4b5ced2b', 'request_id': 'req-1db09026-8925-4ba9-9f53-2685e3f9d6d1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:14.222187 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46b0dfbc5bc4d4697ca625f4b5ced2b', 'request_id': 'req-1db09026-8925-4ba9-9f53-2685e3f9d6d1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:14.228497 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46b0dfbc5bc4d4697ca625f4b5ced2b', 'request_id': 'req-1db09026-8925-4ba9-9f53-2685e3f9d6d1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:14.242381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] The token cache is being invalidate because project a46b0dfbc5bc4d4697ca625f4b5ced2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:14.242745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:14.243324 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-1db09026-8925-4ba9-9f53-2685e3f9d6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:14.244882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1380/2773] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:14 2022] DELETE /identity/v3/projects/a46b0dfbc5bc4d4697ca625f4b5ced2b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:14.249869 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.250153 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.250423 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.268951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:14.270124 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:14.331017 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1394/2774] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:21:14.340070 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.340365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.340643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.359441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:14.360636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:14.371025 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1381/2775] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:14.375322 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.385420 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178db5f-b1ce-46a0-8a63-7a3ccc60fc26 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.390375 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.391141 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.391756 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.392036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.392799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:14.393098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.394799 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.406370 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1395/2776] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:14.410811 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.419856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbc203-9fac-4460-b514-7216b4378cce None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.425368 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.426021 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.426298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.426572 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.427315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.429192 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.468928 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1382/2777] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:14.473267 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.483994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a83e5-4178-4d6e-8e89-b593c68929ed admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.544260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.544935 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.545232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.545508 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.546247 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.548225 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.572539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1396/2778] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:14.576800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.587182 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2d37b-f62a-45cd-81b4-6de6e5bf0b66 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.592044 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.592714 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.593002 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.593279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.594010 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.595650 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.605602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1383/2779] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:14.609393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.619288 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ce5b9-f243-4c24-8e4a-246ef82e2334 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.624115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.624769 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.625057 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.625334 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.626065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.627791 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fc354-614b-4e2b-8b05-a932bc75152f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.637679 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1397/2780] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:14.641991 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.651945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dfb4b-6ff6-4bae-b335-a8557b9971f3 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.657277 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.658147 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.658440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.658753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] PATH_INFO: `/v3/projects/d06c4ecdd57b45cfba970cbc7a5eae21/users/ca603ec97e78407398c2353dcd669b76/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.673557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06c4ecdd57b45cfba970cbc7a5eae21, user_id=ca603ec97e78407398c2353dcd669b76, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.676249 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.691684 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1384/2781] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:14 2022] PUT /identity/v3/projects/d06c4ecdd57b45cfba970cbc7a5eae21/users/ca603ec97e78407398c2353dcd669b76/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:21:14.702151 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.702441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.702759 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.729959 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] MFA Rules not processed for user `ca603ec97e78407398c2353dcd669b76`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:14.731144 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:14.794143 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1398/2782] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:14.800878 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.863198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2cfd1-0544-4af3-ba36-bf43f0869076 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.869040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.869695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.869973 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.870251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.870964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.872862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.901108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1385/2783] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:21:14.905187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:14.915741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf46f-fd0c-4ba9-bcdc-d09195925e57 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:14.973658 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:14.974347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:14.974601 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:14.974931 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:14.975604 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:14.977522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:14.999683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1399/2784] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:14 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:15.003780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.014362 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775c59b-2952-46d2-8916-dec530ab952a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.020611 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.021286 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.021573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.021850 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.022582 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.024224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.035980 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1386/2785] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:15.040277 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.051105 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04468e-b397-4b25-9211-287a5d2b9c38 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.056029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.056946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.057205 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.057481 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] PATH_INFO: `/v3/projects/eff24ffe0481404da5880f59e0eca434/users/db6e6c43680d405d943e8e963110d831/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.073684 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff24ffe0481404da5880f59e0eca434, user_id=db6e6c43680d405d943e8e963110d831, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.076365 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.091445 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1400/2786] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:15 2022] PUT /identity/v3/projects/eff24ffe0481404da5880f59e0eca434/users/db6e6c43680d405d943e8e963110d831/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:15.095818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.106207 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e614d-f0f2-40b8-b941-64bc607d5912 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.165511 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.166180 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.166464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.166835 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.167560 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.169169 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3ea4c-4f9a-45e9-bb0e-7c2875058b07 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.178883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1387/2787] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:15.183345 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.194233 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863481-1f2a-45fe-9343-1fd397727647 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.199840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.200734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.201018 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.201296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] PATH_INFO: `/v3/projects/eff24ffe0481404da5880f59e0eca434/users/db6e6c43680d405d943e8e963110d831/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.203571 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff24ffe0481404da5880f59e0eca434, user_id=db6e6c43680d405d943e8e963110d831, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.206263 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.217216 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1401/2788] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:15 2022] PUT /identity/v3/projects/eff24ffe0481404da5880f59e0eca434/users/db6e6c43680d405d943e8e963110d831/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:15.228108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.228525 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.228947 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.264198 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] MFA Rules not processed for user `db6e6c43680d405d943e8e963110d831`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:15.265364 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:15.337298 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1388/2789] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:21:15.349654 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.352716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:15.430694 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bf6f-da72-4dd2-b83d-9ff71dc93da3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.438002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.439071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.439392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.439717 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.450054 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.451554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04242969-ee56-4e83-a6b7-d032a7eaf0a3 service cinder] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.461559 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1402/2790] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:15.497438 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.560595 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e49c-88d6-452e-b3ac-59e8995b2400 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.565952 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.566940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.567227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.567503 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] PATH_INFO: `/v3/users/ca603ec97e78407398c2353dcd669b76` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.568800 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca603ec97e78407398c2353dcd669b76)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.570814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.624495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca603ec97e78407398c2353dcd669b76'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:15.625129 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca603ec97e78407398c2353dcd669b76'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:15.633746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca603ec97e78407398c2353dcd669b76'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:15.646106 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca603ec97e78407398c2353dcd669b76'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:15.653326 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca603ec97e78407398c2353dcd669b76'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:15.659645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1389/2791] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:15 2022] DELETE /identity/v3/users/ca603ec97e78407398c2353dcd669b76 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:15.665764 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.666284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.666284 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.685360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:15.686546 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:15.744696 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1403/2792] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:15.757602 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:15.759609 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:15.818769 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9df12-f2a2-412c-92f1-020863460aac admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:15.822959 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:15.823604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:15.823890 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:15.824161 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:15.833855 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:15.835351 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:15.844860 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1390/2793] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:16.117978 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:16.119610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:16.132055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0983890-6ce9-47dc-be5b-e7e086c1f2f2 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:16.137821 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:16.138777 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.139058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.139389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] PATH_INFO: `/v3/projects/d06c4ecdd57b45cfba970cbc7a5eae21` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.140678 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06c4ecdd57b45cfba970cbc7a5eae21)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:16.143041 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:16.191048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06c4ecdd57b45cfba970cbc7a5eae21', 'request_id': 'req-b413ce24-27ea-4c96-8958-f1a2d4fbd413'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.196421 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06c4ecdd57b45cfba970cbc7a5eae21', 'request_id': 'req-b413ce24-27ea-4c96-8958-f1a2d4fbd413'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.202382 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06c4ecdd57b45cfba970cbc7a5eae21', 'request_id': 'req-b413ce24-27ea-4c96-8958-f1a2d4fbd413'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.215871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] The token cache is being invalidate because project d06c4ecdd57b45cfba970cbc7a5eae21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:16.216158 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.216775 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.218311 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1404/2794] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:16 2022] DELETE /identity/v3/projects/d06c4ecdd57b45cfba970cbc7a5eae21 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:16.222352 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:16.231688 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54f83c-b094-4287-9f2d-11836edf5e87 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:16.286534 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:16.287450 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.287736 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.288008 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] PATH_INFO: `/v3/users/db6e6c43680d405d943e8e963110d831` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.289231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6e6c43680d405d943e8e963110d831)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:16.291213 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:16.348531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6e6c43680d405d943e8e963110d831'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.349159 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6e6c43680d405d943e8e963110d831'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.358374 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6e6c43680d405d943e8e963110d831'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.370267 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6e6c43680d405d943e8e963110d831'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.376656 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-6e1f1151-a00e-47fd-bb21-c2b19c0be405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6e6c43680d405d943e8e963110d831'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.383185 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1391/2795] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:16 2022] DELETE /identity/v3/users/db6e6c43680d405d943e8e963110d831 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:16.664191 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:16.665704 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:16.679968 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ce24-27ea-4c96-8958-f1a2d4fbd413 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:16.734844 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:16.735710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.735984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.736258 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] PATH_INFO: `/v3/projects/eff24ffe0481404da5880f59e0eca434` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.737568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff24ffe0481404da5880f59e0eca434)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:16.739584 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:16.789794 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff24ffe0481404da5880f59e0eca434', 'request_id': 'req-867520f3-ce84-496f-9212-1e9ca278d6d3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.795253 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff24ffe0481404da5880f59e0eca434', 'request_id': 'req-867520f3-ce84-496f-9212-1e9ca278d6d3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.801286 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff24ffe0481404da5880f59e0eca434', 'request_id': 'req-867520f3-ce84-496f-9212-1e9ca278d6d3'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.814706 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] The token cache is being invalidate because project eff24ffe0481404da5880f59e0eca434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79775) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:16.815000 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.815689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-867520f3-ce84-496f-9212-1e9ca278d6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:16.817275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1405/2796] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:16 2022] DELETE /identity/v3/projects/eff24ffe0481404da5880f59e0eca434 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:16.822509 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.823043 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.823141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.842114 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:16.843417 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:16.915971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1392/2797] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:16.926160 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.926513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.927082 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.949805 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:16.951029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:16.959542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1406/2798] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:21:16.964083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:16.974204 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767985d-a3e0-4b41-8392-0746882337a6 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:16.979848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:16.980510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:16.980794 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:16.981075 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] PATH_INFO: `/v3/domains` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:16.981799 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79776) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:16.982108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:16.983753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:16.995643 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1393/2799] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:16.999814 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.008993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85678b12-9958-4c3e-a650-10b3fe8735d5 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.013998 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.014636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.014951 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.015227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.015907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.018121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.045963 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1407/2800] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:16 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:17.050224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.060745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d91d7-16b8-45ed-821b-6311131dd422 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.117371 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.118040 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.118322 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.118604 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.119327 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.121232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.146355 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1394/2801] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:17 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:17.150574 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.161939 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f428d-1a7b-48c0-83c1-9dfc1d3b3000 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.166871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.167448 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.167734 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.168093 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.168874 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.170509 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.181894 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1408/2802] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:17.186200 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.196508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a2eb6-5c11-4804-9e13-922d84e2a63d admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.201729 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.202392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.202678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.202977 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.203699 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.205290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31297448-57d2-4323-ac7c-8dba394b74af admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.215463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1395/2803] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:17.219852 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.230385 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996437ad-c734-4c89-8999-d33adfb2fedb admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.236313 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.237357 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.237646 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.237918 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] PATH_INFO: `/v3/projects/a884e025d28744c09a20955bd46b6398/users/d28ace3b18424d3bab59da176e98f565/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.253506 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a884e025d28744c09a20955bd46b6398, user_id=d28ace3b18424d3bab59da176e98f565, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.256204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.273052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1409/2804] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:17 2022] PUT /identity/v3/projects/a884e025d28744c09a20955bd46b6398/users/d28ace3b18424d3bab59da176e98f565/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:17.283662 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.283951 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.284222 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.312706 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] MFA Rules not processed for user `d28ace3b18424d3bab59da176e98f565`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:17.313920 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:17.395089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1396/2805] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:17.399904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.461444 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83661a2-df69-4a97-b7ac-8ff5c8443108 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.466192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.466893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.467181 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.467534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] PATH_INFO: `/v3/projects` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.468236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.470157 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.498858 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1410/2806] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:17 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:17.503329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.514242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4378c-707a-4e39-874c-a7a1ac6a1888 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.572995 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.574037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.574442 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.574932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] PATH_INFO: `/v3/users` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.576083 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.579237 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.608436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1397/2807] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:17 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:21:17.612636 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.623363 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a069338-a905-47b7-a1e2-ec712e91f946 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.628836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.629544 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.629833 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.630115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.631001 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.632621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.643389 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1411/2808] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:17.647490 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.657895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc97965-3493-4ea7-979c-a52aa8d4ed3e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.663047 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.663940 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.664223 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.664495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] PATH_INFO: `/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630/users/d557a343e6fd4abaaa5dfbdb94f4208d/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.679218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ce8d4ebd07406aa4b72c8e4b26a630, user_id=d557a343e6fd4abaaa5dfbdb94f4208d, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.681818 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.696415 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1398/2809] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:17 2022] PUT /identity/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630/users/d557a343e6fd4abaaa5dfbdb94f4208d/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:17.700309 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.711331 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa485e-3a4b-496a-b07c-5de79da335c4 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.774884 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.775495 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.775771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.776047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.776760 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.778372 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db388c7c-abdd-4a60-9b24-c84278f16bc1 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.787983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1412/2810] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:17.794473 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.805519 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd0d10-c8b2-4cca-9ed8-cd8ac90158bf admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:17.810555 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:17.811542 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.811816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.812072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] PATH_INFO: `/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630/users/d557a343e6fd4abaaa5dfbdb94f4208d/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.814130 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ce8d4ebd07406aa4b72c8e4b26a630, user_id=d557a343e6fd4abaaa5dfbdb94f4208d, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:17.816781 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:17.827695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1399/2811] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:17 2022] PUT /identity/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630/users/d557a343e6fd4abaaa5dfbdb94f4208d/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:17.837899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:17.838193 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:17.838469 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:17.867278 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] MFA Rules not processed for user `d557a343e6fd4abaaa5dfbdb94f4208d`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:17.868489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:17.937159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1413/2812] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:17.951240 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:17.953154 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:18.010577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ef5-b5c7-42b8-ad2e-4347d188112a admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:18.015695 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:18.016344 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.016971 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.017242 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.027173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:18.028541 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbd0b2-eb17-4159-b21e-9bf194ae642a service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:18.037803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1400/2813] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:18.162681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:18.227394 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbcf43-84f9-4dc5-adeb-30e9dab06904 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:18.234148 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:18.235239 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.235626 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.235867 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] PATH_INFO: `/v3/users/d28ace3b18424d3bab59da176e98f565` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.237731 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28ace3b18424d3bab59da176e98f565)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:18.241505 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:18.296728 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28ace3b18424d3bab59da176e98f565'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.305524 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28ace3b18424d3bab59da176e98f565'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.318676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28ace3b18424d3bab59da176e98f565'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.319433 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28ace3b18424d3bab59da176e98f565'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.320088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28ace3b18424d3bab59da176e98f565'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.332919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1414/2814] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:18 2022] DELETE /identity/v3/users/d28ace3b18424d3bab59da176e98f565 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:18.337766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.338058 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.338333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.357092 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:18.358304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:18.420521 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1401/2815] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:18.433889 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:18.436073 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:18.495655 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ce78d-e188-438d-be0d-95afb5ac1961 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:18.500080 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:18.500732 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.501016 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.501273 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.510688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:18.512164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:18.522207 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1415/2816] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:18.788319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:18.789803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:18.803661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893646bd-c005-429f-ae97-92aa7971ba2e None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:18.809528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:18.810366 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.810671 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.810948 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] PATH_INFO: `/v3/projects/a884e025d28744c09a20955bd46b6398` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.812316 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a884e025d28744c09a20955bd46b6398)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:18.814193 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:18.870361 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a884e025d28744c09a20955bd46b6398', 'request_id': 'req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.878206 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a884e025d28744c09a20955bd46b6398', 'request_id': 'req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.884570 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a884e025d28744c09a20955bd46b6398', 'request_id': 'req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.899019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] The token cache is being invalidate because project a884e025d28744c09a20955bd46b6398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:18.899278 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.899918 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:18.901624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1402/2817] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:18 2022] DELETE /identity/v3/projects/a884e025d28744c09a20955bd46b6398 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:18.906062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:18.915788 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff9064-dc73-4d6f-9fc4-29ceae04b3f6 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:18.971048 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:18.971983 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:18.972291 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:18.972566 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] PATH_INFO: `/v3/users/d557a343e6fd4abaaa5dfbdb94f4208d` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:18.973796 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d557a343e6fd4abaaa5dfbdb94f4208d)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:18.975746 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.021822 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd557a343e6fd4abaaa5dfbdb94f4208d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.030609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd557a343e6fd4abaaa5dfbdb94f4208d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.042351 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd557a343e6fd4abaaa5dfbdb94f4208d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.043030 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd557a343e6fd4abaaa5dfbdb94f4208d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.043644 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-44a63140-ed65-4a25-a134-f0f6dae89d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd557a343e6fd4abaaa5dfbdb94f4208d'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.056293 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1416/2818] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:18 2022] DELETE /identity/v3/users/d557a343e6fd4abaaa5dfbdb94f4208d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:19.322104 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.323728 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:19.342722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e00cf-782f-4879-afb2-16fd6ba7f6c1 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.400393 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.401273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.401573 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.401848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] PATH_INFO: `/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.403099 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ce8d4ebd07406aa4b72c8e4b26a630)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.404994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.452856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ce8d4ebd07406aa4b72c8e4b26a630', 'request_id': 'req-b343d790-7683-432d-bddf-a4e8e4636977'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.458148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ce8d4ebd07406aa4b72c8e4b26a630', 'request_id': 'req-b343d790-7683-432d-bddf-a4e8e4636977'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.464068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ce8d4ebd07406aa4b72c8e4b26a630', 'request_id': 'req-b343d790-7683-432d-bddf-a4e8e4636977'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.479033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] The token cache is being invalidate because project a5ce8d4ebd07406aa4b72c8e4b26a630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:19.479315 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.479953 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-b343d790-7683-432d-bddf-a4e8e4636977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:19.481564 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1403/2819] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:19 2022] DELETE /identity/v3/projects/a5ce8d4ebd07406aa4b72c8e4b26a630 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:19.486594 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.486940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.487204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.505862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:19.507083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:19.570592 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1417/2820] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:19.578624 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.578846 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.579141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.598848 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:19.600062 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:19.608633 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1404/2821] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:19.613465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.624200 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f135a4c-8e4c-404f-8cc8-ce0c641eb67b None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.630316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.631020 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.631305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.631572 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.632304 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:19.632607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.634219 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.646582 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1418/2822] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:19.651304 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.660883 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564fce0-8068-4d30-8ada-d61a2a15a1ab None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.666440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.667120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.667401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.667674 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.668396 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.670314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.699313 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1405/2823] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:19 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:19.703484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.713758 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727095-d178-4707-93a6-92efbcfe7094 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.770088 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.770771 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.771051 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.771325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.771985 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.773940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.795721 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1419/2824] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:19 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:19.800248 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.810471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45bd10-58b1-4163-8b7a-6a812589ea57 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.815441 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.816153 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.816436 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.816710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.817430 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.819063 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.829111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1406/2825] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:19.833320 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.843511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ca1-849f-48a3-a604-12a9b6923e7b admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.848871 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41258625-3096-411d-a295-305de7213d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.849550 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258625-3096-411d-a295-305de7213d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.849834 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258625-3096-411d-a295-305de7213d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.850118 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41258625-3096-411d-a295-305de7213d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.850887 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41258625-3096-411d-a295-305de7213d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.852482 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41258625-3096-411d-a295-305de7213d14 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.862256 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1420/2826] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:19.866531 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:19.876510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aa0d1-6c28-4a8e-b2d8-ff8b60c8af01 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:19.881440 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:19.882319 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.882606 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.882916 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] PATH_INFO: `/v3/projects/e7789234144c4a5a9934470b43a3e03b/users/1d0ccda408c24c739407bc7f7899b546/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.898950 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7789234144c4a5a9934470b43a3e03b, user_id=1d0ccda408c24c739407bc7f7899b546, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:19.901586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:19.915812 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1407/2827] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:19 2022] PUT /identity/v3/projects/e7789234144c4a5a9934470b43a3e03b/users/1d0ccda408c24c739407bc7f7899b546/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:19.927002 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:19.927542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:19.927542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:19.954376 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] MFA Rules not processed for user `1d0ccda408c24c739407bc7f7899b546`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:19.955611 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:20.022585 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1421/2828] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:20.037293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:20.039587 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:20.101252 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbac19-89e3-462f-a431-6d8177fb0afe admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:20.105576 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:20.106231 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:20.106498 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:20.106803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:20.115726 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:20.117158 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e3b3f-c063-4e52-9f2a-1d8eaff69359 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:20.125908 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1408/2829] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:23.142916 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:23.205440 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06b32-0dc8-446f-b7ad-1d1debc0a01c None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:23.210070 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:23.211079 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.211366 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.211645 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] PATH_INFO: `/v3/users/1d0ccda408c24c739407bc7f7899b546` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.212846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0ccda408c24c739407bc7f7899b546)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:23.214823 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:23.261036 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0ccda408c24c739407bc7f7899b546'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.272359 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0ccda408c24c739407bc7f7899b546'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.284223 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0ccda408c24c739407bc7f7899b546'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.284908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0ccda408c24c739407bc7f7899b546'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.285500 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0ccda408c24c739407bc7f7899b546'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.297227 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1422/2830] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:23 2022] DELETE /identity/v3/users/1d0ccda408c24c739407bc7f7899b546 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:23.302012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.302528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.302528 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.320856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:23.322148 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:23.380279 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1409/2831] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:23.390534 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:23.392512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:23.451919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c7c1-30be-4d28-903f-fa9881ae2755 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:23.456457 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:23.457062 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.457349 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.457629 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.467652 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:23.469192 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f176e-16b7-42e5-8542-93437c33f047 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:23.479465 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1423/2832] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:23.764111 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:23.765821 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:23.780466 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ccbfe-fe8f-403e-ad5f-dd5c5beca707 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:23.785647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:23.786536 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.786856 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.787137 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] PATH_INFO: `/v3/projects/e7789234144c4a5a9934470b43a3e03b` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.788334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7789234144c4a5a9934470b43a3e03b)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:23.790482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:23.841333 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7789234144c4a5a9934470b43a3e03b', 'request_id': 'req-0b5a495b-ebfd-463f-a521-90d40636c355'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.847300 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7789234144c4a5a9934470b43a3e03b', 'request_id': 'req-0b5a495b-ebfd-463f-a521-90d40636c355'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.853900 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7789234144c4a5a9934470b43a3e03b', 'request_id': 'req-0b5a495b-ebfd-463f-a521-90d40636c355'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.868746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] The token cache is being invalidate because project e7789234144c4a5a9934470b43a3e03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:23.869035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.869712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-0b5a495b-ebfd-463f-a521-90d40636c355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:23.871411 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1410/2833] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:23 2022] DELETE /identity/v3/projects/e7789234144c4a5a9934470b43a3e03b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:23.876657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.876949 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.877245 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.896360 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:23.897595 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:23.958206 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1424/2834] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:23.967314 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:23.967616 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:23.967887 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:23.987722 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:23.988945 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:23.998976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1411/2835] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:24.003836 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.015547 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96955a-0fa7-4d7e-b374-264f4e25df79 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.022042 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.022689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.023005 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.023275 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.023993 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:24.024301 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.025922 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.037954 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1425/2836] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:24.042381 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.052012 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14c55-401d-44bc-bf6a-dbdc67ffb51b None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.057566 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.058225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.058510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.058806 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.059504 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.061406 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.091425 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1412/2837] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:24.095816 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.106004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b032980-f768-46a4-9579-8295959437ed admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.163979 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.164690 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.164996 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.165276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.165961 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.167972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.192413 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1426/2838] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:24 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:24.196824 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.207255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bbe2c-054a-449d-8594-7a1120a9be37 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.212004 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.212596 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.212877 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.213149 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.213872 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.215495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.225636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1413/2839] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:24.229486 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.239319 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeefca-7374-4fb8-a4fe-59f90ca50916 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.244052 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.244705 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.244995 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.245242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.245966 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.247599 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386f6b-a3a2-499e-ad9c-b4d0e268ccf8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.257106 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1427/2840] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:24.261463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.272020 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfa56a-7d87-4dfc-9003-a3bc8f2c0a96 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.277552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.278349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.278636 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.278946 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] PATH_INFO: `/v3/projects/0f83012bac3a48bab73a80090d34e068/users/f56d5393f9fc4489acc4fcff55cb81bb/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.294072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f83012bac3a48bab73a80090d34e068, user_id=f56d5393f9fc4489acc4fcff55cb81bb, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.296753 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.311251 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1414/2841] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:24 2022] PUT /identity/v3/projects/0f83012bac3a48bab73a80090d34e068/users/f56d5393f9fc4489acc4fcff55cb81bb/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:21:24.321587 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.321898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.322164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.350827 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] MFA Rules not processed for user `f56d5393f9fc4489acc4fcff55cb81bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:24.352075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:24.415699 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1428/2842] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:24.427934 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:24.429923 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:24.505613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec727a26-19a5-412b-9854-d0d4615ae24e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:24.509635 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aba5e29ac89d4fd19a1c882830c2ef1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:24.510287 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:24.510544 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:24.510882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:24.519744 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:24.521171 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44e8e5-a506-40ae-876e-b0a4d2f6e597 service glance] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:24.530033 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1415/2843] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:55.495069 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:55.561047 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f908e-0d2a-482b-9d3f-adb5aa3cdf11 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:55.569287 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:55.570208 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:55.570492 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:55.570797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] PATH_INFO: `/v3/users/f56d5393f9fc4489acc4fcff55cb81bb` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:55.572117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56d5393f9fc4489acc4fcff55cb81bb)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:55.574061 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:55.624115 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56d5393f9fc4489acc4fcff55cb81bb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:55.632687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56d5393f9fc4489acc4fcff55cb81bb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:55.651537 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56d5393f9fc4489acc4fcff55cb81bb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:55.652516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56d5393f9fc4489acc4fcff55cb81bb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:55.653405 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56d5393f9fc4489acc4fcff55cb81bb'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:55.667716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1429/2844] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:55 2022] DELETE /identity/v3/users/f56d5393f9fc4489acc4fcff55cb81bb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:55.672626 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:55.673166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:55.673166 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:55.693739 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:55.694993 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:55.757118 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1416/2845] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:55.768671 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:55.770499 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:55.826257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e3f9-3e67-49b6-8f51-4dd8f1090fa2 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:55.830511 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:55.831212 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:55.831498 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:55.831797 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:55.840727 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:55.842149 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de1495-e582-40e8-a33f-b2a31d82e846 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:55.851902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1430/2846] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:56.134641 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.136378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:56.149407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b4ea-1e11-489a-a344-2f9f15b3a5ea None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.154391 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.155294 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.155577 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.155853 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] PATH_INFO: `/v3/projects/0f83012bac3a48bab73a80090d34e068` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.157046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f83012bac3a48bab73a80090d34e068)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.159135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.207016 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f83012bac3a48bab73a80090d34e068', 'request_id': 'req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:56.212317 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f83012bac3a48bab73a80090d34e068', 'request_id': 'req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:56.218394 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f83012bac3a48bab73a80090d34e068', 'request_id': 'req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:56.232645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] The token cache is being invalidate because project 0f83012bac3a48bab73a80090d34e068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:56.232930 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:56.233586 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-ab99d873-c73a-4510-b8de-f50fd2e5d6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:56.235196 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1417/2847] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:56 2022] DELETE /identity/v3/projects/0f83012bac3a48bab73a80090d34e068 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:56.240335 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.240625 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.240902 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.258992 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:56.260142 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:56.319493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1431/2848] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:56.327464 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.327748 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.328035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.347093 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:56.348306 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:56.357055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1418/2849] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:21:56.361521 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.371669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbffe17-5378-41d4-aa72-1d1713f97ae8 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.377516 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.378164 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.378441 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.378742 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.379460 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:56.379762 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.381343 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.393623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1432/2850] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:56.397915 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.407365 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4249e-dce1-4168-b014-211c3d8c1890 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.413546 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.414188 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.414463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.414816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.415510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.417388 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.444897 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1419/2851] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:56 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:56.449103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.459161 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c3a5d-fe36-44b5-b0a2-845a5bbe64b8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.518203 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.518861 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.519083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.519356 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.520029 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.521948 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.547919 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1433/2852] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:56 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:56.552173 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.562562 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d90ab4-3844-4234-ba0b-0c1cf5498825 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.567478 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.568128 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.568407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.568661 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.569527 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.571160 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.581433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1420/2853] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:56.585214 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.595175 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18af4b0-4b46-4cbc-a013-07a0bc6345d3 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.600232 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.600895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.601185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.601454 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.602172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.603786 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e5b16-91ad-42fa-8a72-af376830dfbc admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.613687 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1434/2854] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:56.617768 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.627598 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee90e8-521a-4ded-b45f-752296f44f6e admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.633607 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.634475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.634786 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.635059 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] PATH_INFO: `/v3/projects/3a04cee99c0843ceb5bee344d7f9c991/users/8ef41feb07a5407c97575243d0835604/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.650340 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a04cee99c0843ceb5bee344d7f9c991, user_id=8ef41feb07a5407c97575243d0835604, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.653003 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.668135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1421/2855] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:56 2022] PUT /identity/v3/projects/3a04cee99c0843ceb5bee344d7f9c991/users/8ef41feb07a5407c97575243d0835604/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:21:56.730701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.731010 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.731417 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.766024 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] MFA Rules not processed for user `8ef41feb07a5407c97575243d0835604`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:56.767662 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:56.829944 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1435/2856] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:56.844408 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:56.847556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:56.920535 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7694ffa-3ab2-4b99-90f2-5faa676db249 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:56.925290 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:56.925942 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:56.926224 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:56.926496 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:56.935435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:56.936882 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c041cf-570e-4abc-a7ae-fc8efd24252b service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:56.945758 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1422/2857] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:56.972008 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.034438 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e8e9f-735d-4191-b178-9b549b774397 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.039741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.040610 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.040893 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.041166 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] PATH_INFO: `/v3/users/8ef41feb07a5407c97575243d0835604` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.042464 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef41feb07a5407c97575243d0835604)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.044408 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:57.094129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef41feb07a5407c97575243d0835604'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.102627 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef41feb07a5407c97575243d0835604'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.115439 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef41feb07a5407c97575243d0835604'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.116185 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef41feb07a5407c97575243d0835604'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.116895 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef41feb07a5407c97575243d0835604'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.129964 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1436/2858] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:21:56 2022] DELETE /identity/v3/users/8ef41feb07a5407c97575243d0835604 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:57.134686 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.134964 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.135238 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.153115 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:57.154308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:57.213749 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1423/2859] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:57.225119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.226676 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:57.284101 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5cb5d-5a2e-4523-80b1-ddb0b93e648e admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.288461 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.289104 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.289523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.289801 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.299083 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.300510 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26556e1a-c7d5-4800-ba80-d91d2560c140 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:57.310098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1437/2860] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:21:57.587931 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.589390 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:57.601495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59731730-fe0b-4841-899c-53bcd26a6a13 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.606407 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.607310 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.607712 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.607997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] PATH_INFO: `/v3/projects/3a04cee99c0843ceb5bee344d7f9c991` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.609227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a04cee99c0843ceb5bee344d7f9c991)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.611532 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:57.659500 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a04cee99c0843ceb5bee344d7f9c991', 'request_id': 'req-03c509d1-4316-41c0-80f5-172ff6264fa3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.665120 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a04cee99c0843ceb5bee344d7f9c991', 'request_id': 'req-03c509d1-4316-41c0-80f5-172ff6264fa3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.671123 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a04cee99c0843ceb5bee344d7f9c991', 'request_id': 'req-03c509d1-4316-41c0-80f5-172ff6264fa3'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.686795 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] The token cache is being invalidate because project 3a04cee99c0843ceb5bee344d7f9c991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:21:57.687087 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.687713 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-03c509d1-4316-41c0-80f5-172ff6264fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:21:57.689262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1424/2861] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:21:57 2022] DELETE /identity/v3/projects/3a04cee99c0843ceb5bee344d7f9c991 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:57.694321 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.694846 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.694977 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.713876 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:57.715121 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:57.773754 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1438/2862] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:57.784911 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.785201 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.785471 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.807937 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:57.809186 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:57.818700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1425/2863] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:21:57.823058 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.833530 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb812c-8b2d-4d10-9e15-3e472c2186e1 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.839489 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.840172 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.840458 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.840729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] PATH_INFO: `/v3/domains` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.841479 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79775) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 01 10:21:57.841785 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.843478 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:57.855619 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1439/2864] 10.222.0.46 () {58 vars in 1152 bytes} [Fri Apr 1 10:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 01 10:21:57.860202 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.870378 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fc602-6735-4896-942f-0542ca3428c2 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.876329 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.877134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.877522 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.877801 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.878551 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.880510 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:57.910369 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1426/2865] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:21:57 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:57.914493 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:57.924607 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb9576-3813-4723-8978-587f30677efd admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:57.979994 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:57.980716 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:57.980972 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:57.981242 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:57.981921 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:57.983892 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:58.007660 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1440/2866] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:21:57 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:21:58.011841 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:58.022556 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e02b4-bb9f-487e-90d9-63aa636ea762 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:58.027775 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:58.028426 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:58.028709 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:58.028976 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:58.029710 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:58.031401 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:58.041715 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1427/2867] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:58.045579 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:58.055752 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c708-993b-48dd-92a5-082411cd27d7 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:58.060890 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:58.061554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:58.061840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:58.062117 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:58.062925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:58.064545 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698ec8c-910f-4ec5-a476-2b62a15130fc admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:58.074666 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1441/2868] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:21:58.078759 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:58.088746 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d937e-ec23-4dc7-af83-a2a8caeba0cb admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:58.094323 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:58.095232 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] REQUEST_METHOD: `PUT` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:58.095518 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:58.095791 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] PATH_INFO: `/v3/projects/246bc36f10274d35821692e2c7fed45a/users/3915ad324c4c4f1da32715584f8d9ca7/roles/093bf7d1ef5340058d9e975518b94a39` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:58.110798 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246bc36f10274d35821692e2c7fed45a, user_id=3915ad324c4c4f1da32715584f8d9ca7, role_id=093bf7d1ef5340058d9e975518b94a39)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:58.113493 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:58.129502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1428/2869] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:21:58 2022] PUT /identity/v3/projects/246bc36f10274d35821692e2c7fed45a/users/3915ad324c4c4f1da32715584f8d9ca7/roles/093bf7d1ef5340058d9e975518b94a39 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:21:58.134542 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4e21-99eb-4402-aa35-eb1a9690d294 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:58.134907 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4e21-99eb-4402-aa35-eb1a9690d294 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:58.135188 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4e21-99eb-4402-aa35-eb1a9690d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:58.153755 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-e87a4e21-99eb-4402-aa35-eb1a9690d294 None None] MFA Rules not processed for user `763b9bb9696f4539b6048050128f2089`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:21:58.155009 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-e87a4e21-99eb-4402-aa35-eb1a9690d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:58.214898 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1442/2870] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 01 10:21:58.224895 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:21:58.226765 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:21:58.288631 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eeba79-b2c2-4e03-9c85-7ee1a6124682 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:21:58.295273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:21:58.296226 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:21:58.296592 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:21:58.296954 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:21:58.307988 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:21:58.309422 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:21:58.318888 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1429/2871] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:02.248905 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.249740 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.250194 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.281743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] MFA Rules not processed for user `3915ad324c4c4f1da32715584f8d9ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:22:02.283647 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:02.348046 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1443/2872] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:22:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:22:02.352730 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.363476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1e292-4fd5-4012-a8e1-1c1e897e4983 service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.368334 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.369218 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.369600 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.370133 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.371068 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.372990 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.405100 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1430/2873] 10.222.0.46 () {60 vars in 1152 bytes} [Fri Apr 1 10:22:02 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 01 10:22:02.406096 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.438131 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbd6aa-b27e-4cdc-9193-3e98598ac738 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.505523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.506283 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.506568 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.506888 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] PATH_INFO: `/v3/users` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.507623 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.509609 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.535023 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1444/2874] 10.222.0.46 () {60 vars in 1143 bytes} [Fri Apr 1 10:22:02 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 01 10:22:02.536463 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.547392 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b02d-091c-4bad-b7a8-d1b732079a79 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.552077 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.552752 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.553035 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.553312 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.554037 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.555803 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.568805 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1431/2875] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 01 10:22:02.573718 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.584523 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa77ae-05cd-4083-b5f1-f7f1e37a5cda admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.589276 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.590189 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.590473 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.590784 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] PATH_INFO: `/v3/projects/1795317141ef4405938e5181f9b5db1d/users/ca98837fa0d840f185f21dc0262114e0/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.606374 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1795317141ef4405938e5181f9b5db1d, user_id=ca98837fa0d840f185f21dc0262114e0, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.609130 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.623280 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1445/2876] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:22:02 2022] PUT /identity/v3/projects/1795317141ef4405938e5181f9b5db1d/users/ca98837fa0d840f185f21dc0262114e0/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:22:02.627468 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.638247 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539a974-3e2f-4856-ae6b-eda0c12727d7 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.696549 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.697227 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.697508 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.697780 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.698677 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.700280 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0073e-e8c0-4f99-a3c1-0b4c16e5f4b2 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.710557 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1432/2877] 10.222.0.46 () {58 vars in 1121 bytes} [Fri Apr 1 10:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 01 10:22:02.714904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:02.725675 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96dc2d-423b-4f72-83c1-91af95a8241d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:02.730513 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:02.731462 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:02.731815 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:02.732098 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] PATH_INFO: `/v3/projects/1795317141ef4405938e5181f9b5db1d/users/ca98837fa0d840f185f21dc0262114e0/roles/f9d36af787804f248e9bea8324501c2a` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:02.734120 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1795317141ef4405938e5181f9b5db1d, user_id=ca98837fa0d840f185f21dc0262114e0, role_id=f9d36af787804f248e9bea8324501c2a)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:02.736840 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:02.748155 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1446/2878] 10.222.0.46 () {60 vars in 1482 bytes} [Fri Apr 1 10:22:02 2022] PUT /identity/v3/projects/1795317141ef4405938e5181f9b5db1d/users/ca98837fa0d840f185f21dc0262114e0/roles/f9d36af787804f248e9bea8324501c2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:22:07.184997 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:07.185766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:07.185766 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:07.214135 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] MFA Rules not processed for user `ca98837fa0d840f185f21dc0262114e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:22:07.215383 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:07.285902 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1433/2879] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:22:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:22:07.299908 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:07.301702 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:07.379538 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338e13-97dc-4e4c-ae25-98c6e28f3e0f admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:07.385327 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:07.385984 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:07.386269 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:07.386548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:07.446741 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:07.448336 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbcb416-7752-4bc2-84f2-992b7d0ef1e7 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:07.457393 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1447/2880] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:20.569645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:20.571372 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:20.653869 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20f61-ce9a-41fb-bb39-ece9a43347fc None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:20.659700 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:20.660342 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:20.660622 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:20.660894 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:20.662789 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:20.674089 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:20.675761 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:20.685679 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1434/2881] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:27.336352 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:27.336906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:27.336906 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:27.355512 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] MFA Rules not processed for user `3915ad324c4c4f1da32715584f8d9ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:22:27.356729 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:27.365119 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1448/2882] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:22:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:22:27.678926 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:27.680435 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:27.740483 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6a628-69b9-4055-a0ee-08dfeac80b5e service placement] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:27.744822 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:27.745461 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:27.745742 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:27.746019 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:27.748108 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:27.758030 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:27.759495 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:27.767939 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1435/2883] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:28.209681 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:28.211187 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:28.227217 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edb98e-22d8-4296-addd-03b3c5e59a8e None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:28.233338 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:28.233997 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:28.234281 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:28.234560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:28.236669 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:28.249946 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:28.251598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:28.264613 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1449/2884] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:41.807814 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:41.821984 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d214a9-3858-4424-a298-99d97ebc851d service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:41.827621 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:41.828303 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:41.828585 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:41.828862 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:41.831081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:22:41.844448 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:41.846081 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:41.856857 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1436/2885] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:22:43.836688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:22:43.847296 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9b0ae-ff5c-44c4-9012-68912056bbb5 service placement] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:22:43.851885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:22:43.852673 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:22:43.852960 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:22:43.853230 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:22:43.863055 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:22:43.864485 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:22:43.874004 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1450/2886] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:25:00.125979 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:25:00.138760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb440d2-294e-49b8-b810-1eec462ccf3a service nova] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:25:00.143826 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:25:00.144475 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:25:00.144760 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:25:00.145034 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:25:00.147134 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:25:00.162046 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:25:00.163517 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c933edcc-4309-450c-937d-36f1a06e4d5d service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:25:00.175685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1437/2887] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:25:01.382549 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:25:01.391743 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc27e4-5c27-4136-afc6-028ea197bb53 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:25:01.396316 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:25:01.396958 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:25:01.397236 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:25:01.397504 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:25:01.399539 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:25:01.413710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:25:01.415163 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:25:01.426204 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1451/2888] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:25:03.748550 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] REQUEST_METHOD: `POST` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:25:03.749444 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:25:03.749723 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:25:03.768610 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.auth.core [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] MFA Rules not processed for user `3915ad324c4c4f1da32715584f8d9ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79776) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:25:03.769901 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:25:03.777647 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1438/2889] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:25:20.985641 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:25:20.994554 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3a59-a1db-4fdc-8212-2c2a625a3aa8 service neutron] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:25:20.998404 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:25:20.999103 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:25:20.999392 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:25:20.999680 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:25:21.001877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:25:21.012399 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:25:21.013904 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0282f8c-f4bf-400f-80e8-5f2eb2e4e691 service neutron] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:25:21.022872 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1452/2890] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:25:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:27:07.128552 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:27:07.130305 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:27:07.191663 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05097c-1a9d-4e2f-ba93-f83d5ca26768 None None] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:27:07.196000 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1ac29fcbcdc4bcfacfa2695a3bba6eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:27:07.196645 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:07.196932 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:07.197205 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:07.209432 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:27:07.210914 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:27:07.220065 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1439/2891] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:27:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:27:16.267689 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] REQUEST_METHOD: `POST` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:16.268261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:16.268261 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:16.287588 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.auth.core [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] MFA Rules not processed for user `3915ad324c4c4f1da32715584f8d9ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=79775) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 01 10:27:16.288804 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:27:16.298050 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1453/2892] 10.222.0.46 () {58 vars in 957 bytes} [Fri Apr 1 10:27:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 01 10:27:16.622225 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:27:16.633320 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81239c8-b01f-40ee-a5cd-2ae729eeb5a6 service cinder] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:27:16.637975 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:27:16.639027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:16.639273 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:16.639575 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:16.641613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:27:16.651613 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:27:16.653038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:27:16.661308 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1440/2893] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:27:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:27:19.638952 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:27:19.695934 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ac85b-018e-43b6-9f6d-46093eed0ac0 None None] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:27:19.701945 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:27:19.703075 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:19.703548 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:19.703828 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:19.705677 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:27:19.739925 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:27:19.741877 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:27:19.753591 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1454/2894] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:27:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:27:27.545476 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:27:27.588484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2861f6-57fe-42c5-af72-f49ed1b3ce1f service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:27:27.594678 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:27:27.595349 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:27.595638 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:27.595906 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:27.604788 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:27:27.606360 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:27:27.616255 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1441/2895] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:27:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:27:37.078688 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:27:37.090257 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538c30c-3920-4710-be53-239c4dcd7746 service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:27:37.096059 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e04e4b6a2827449dbe36886a303f7a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:27:37.096856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:27:37.097137 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:27:37.097386 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:27:37.099657 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:27:37.113019 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:27:37.114621 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:27:37.125412 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1455/2896] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:27:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:29:43.510243 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:29:43.530363 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8cd30-f982-4afe-87c4-2458f2b6a657 service placement] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:29:43.534097 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c8f234c44684cdfa836b64c3c87fc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:29:43.534770 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] REQUEST_METHOD: `GET` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:29:43.535055 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:29:43.535330 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:29:43.594682 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:29:43.596144 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:29:43.606072 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1442/2897] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 01 10:29:49.857347 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:29:49.869260 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16abbe-e5df-4a1e-a302-1f55ed4cd9b3 service nova] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:29:49.873910 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:29:49.875569 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:29:49.875856 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:29:49.876129 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] PATH_INFO: `/v3/users/3915ad324c4c4f1da32715584f8d9ca7` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:29:49.877342 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3915ad324c4c4f1da32715584f8d9ca7)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:29:49.879299 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:29:49.926165 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3915ad324c4c4f1da32715584f8d9ca7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:49.933683 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3915ad324c4c4f1da32715584f8d9ca7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:49.945071 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3915ad324c4c4f1da32715584f8d9ca7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:49.945701 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3915ad324c4c4f1da32715584f8d9ca7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:49.946305 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3915ad324c4c4f1da32715584f8d9ca7'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:49.957862 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1456/2898] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:29:49 2022] DELETE /identity/v3/users/3915ad324c4c4f1da32715584f8d9ca7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:29:50.133667 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:29:50.144482 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd74f0-3b80-421b-a470-494556a975fc service neutron] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:29:50.202825 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:29:50.203703 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:29:50.203989 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:29:50.204262 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] PATH_INFO: `/v3/projects/246bc36f10274d35821692e2c7fed45a` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:29:50.205484 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246bc36f10274d35821692e2c7fed45a)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:29:50.207433 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:29:50.256816 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246bc36f10274d35821692e2c7fed45a', 'request_id': 'req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.262502 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246bc36f10274d35821692e2c7fed45a', 'request_id': 'req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.268332 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246bc36f10274d35821692e2c7fed45a', 'request_id': 'req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.282293 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] The token cache is being invalidate because project 246bc36f10274d35821692e2c7fed45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:29:50.282553 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.283208 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.284755 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1443/2899] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:29:50 2022] DELETE /identity/v3/projects/246bc36f10274d35821692e2c7fed45a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 01 10:29:50.288885 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:29:50.290398 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:29:50.303484 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46081032-919a-4b49-b38e-4df4856d445d admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:29:50.364178 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:29:50.364988 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:29:50.365252 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:29:50.365560 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] PATH_INFO: `/v3/users/ca98837fa0d840f185f21dc0262114e0` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:29:50.366899 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca98837fa0d840f185f21dc0262114e0)` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:29:50.368824 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:29:50.426371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca98837fa0d840f185f21dc0262114e0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.437159 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca98837fa0d840f185f21dc0262114e0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.454640 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca98837fa0d840f185f21dc0262114e0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.455710 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca98837fa0d840f185f21dc0262114e0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.456770 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.notifications [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca98837fa0d840f185f21dc0262114e0'} {{(pid=79775) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.471598 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1457/2900] 10.222.0.46 () {58 vars in 1223 bytes} [Fri Apr 1 10:29:50 2022] DELETE /identity/v3/users/ca98837fa0d840f185f21dc0262114e0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:29:50.648685 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Authenticating user token {{(pid=79776) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:29:50.650141 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.fernet_utils [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79776) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:29:50.663994 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761c4d-58c4-49be-b4c9-c3fd6a5e1404 admin admin] Validating token access rules against request {{(pid=79776) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:29:50.721793 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '763b9bb9696f4539b6048050128f2089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '049efb42322340008044df453447aaa7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79776) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:29:50.722681 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:29:50.723027 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:29:50.723321 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] PATH_INFO: `/v3/projects/1795317141ef4405938e5181f9b5db1d` {{(pid=79776) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:29:50.724516 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1795317141ef4405938e5181f9b5db1d)` {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:29:50.726457 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] RBAC: Authorization granted {{(pid=79776) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:29:50.773132 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1795317141ef4405938e5181f9b5db1d', 'request_id': 'req-dff38362-85e0-415e-a594-2f3087650189'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.778309 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1795317141ef4405938e5181f9b5db1d', 'request_id': 'req-dff38362-85e0-415e-a594-2f3087650189'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.784410 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1795317141ef4405938e5181f9b5db1d', 'request_id': 'req-dff38362-85e0-415e-a594-2f3087650189'} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.797745 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] The token cache is being invalidate because project 1795317141ef4405938e5181f9b5db1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79776) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 01 10:29:50.798038 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.798701 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: DEBUG keystone.notifications [None req-dff38362-85e0-415e-a594-2f3087650189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79776) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 01 10:29:50.800302 dv-cinder-master-3-iscsi devstack@keystone.service[79776]: [pid: 79776|app: 0|req: 1444/2901] 10.222.0.46 () {58 vars in 1232 bytes} [Fri Apr 1 10:29:50 2022] DELETE /identity/v3/projects/1795317141ef4405938e5181f9b5db1d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 01 10:32:33.515685 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Authenticating user token {{(pid=79775) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 01 10:32:33.517371 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:32:33.600602 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7bf7b-d913-4940-b143-8be674b393a8 admin admin] Validating token access rules against request {{(pid=79775) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 01 10:32:33.659875 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31d9c1639edd4e40a16ad8809dc20353', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a1542346e474cd0a916b786b8ee8623', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79775) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 01 10:32:33.660522 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] REQUEST_METHOD: `GET` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 01 10:32:33.660802 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] SCRIPT_NAME: `/identity` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 01 10:32:33.661066 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79775) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 01 10:32:33.663065 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.fernet_utils [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79775) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 01 10:32:33.674325 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 01 10:32:33.675940 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2b2a4-574a-4306-ad7a-2cc223ef5816 service placement] RBAC: Authorization granted {{(pid=79775) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 01 10:32:33.685733 dv-cinder-master-3-iscsi devstack@keystone.service[79775]: [pid: 79775|app: 0|req: 1458/2902] 10.222.0.46 () {60 vars in 1365 bytes} [Fri Apr 1 10:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)